Nov 22 15:48:35 user nova-compute[75734]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75734) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75734) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75734) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 15:48:35 user nova-compute[75734]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.017s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:48:35 user nova-compute[75734]: INFO nova.virt.driver [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 22 15:48:35 user nova-compute[75734]: INFO nova.compute.provider_config [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Acquiring lock "singleton_lock" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Acquired lock "singleton_lock" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Releasing lock "singleton_lock" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Full set of CONF: {{(pid=75734) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ******************************************************************************** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Configuration options gathered from: {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ================================================================================ {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] allow_resize_to_same_host      = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] arq_binding_timeout            = 300 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] backdoor_port                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] backdoor_socket                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] block_device_allocate_retries  = 300 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] block_device_allocate_retries_interval = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cert                           = self.pem {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute_monitors               = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] config_dir                     = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] config_drive_format            = iso9660 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] config_source                  = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] console_host                   = user {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] control_exchange               = nova {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cpu_allocation_ratio           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] daemon                         = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] debug                          = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] default_access_ip_network_name = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] default_availability_zone      = nova {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] default_ephemeral_format       = ext4 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] default_green_pool_size        = 1000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] default_schedule_zone          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] disk_allocation_ratio          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] enable_new_services            = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] enabled_apis                   = ['osapi_compute'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] enabled_ssl_apis               = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] flat_injected                  = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] force_config_drive             = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] force_raw_images               = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] graceful_shutdown_timeout      = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] heal_instance_info_cache_interval = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] host                           = user {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instance_build_timeout         = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instance_delete_interval       = 300 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instance_format                = [instance: %(uuid)s]  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instance_name_template         = instance-%08x {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instance_usage_audit           = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instance_usage_audit_period    = month {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] internal_service_availability_zone = internal {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] key                            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] live_migration_retry_count     = 30 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_config_append              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_dir                        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_file                       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_options                    = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_rotate_interval            = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_rotate_interval_type       = days {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] log_rotation_type              = none {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] long_rpc_timeout               = 1800 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] max_concurrent_builds          = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] max_concurrent_live_migrations = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] max_concurrent_snapshots       = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] max_local_block_devices        = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] max_logfile_count              = 30 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] max_logfile_size_mb            = 200 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] maximum_instance_delete_attempts = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] metadata_listen                = 0.0.0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] metadata_listen_port           = 8775 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] metadata_workers               = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] migrate_max_retries            = -1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] mkisofs_cmd                    = genisoimage {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] my_ip                          = 10.0.0.210 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] network_allocate_retries       = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] osapi_compute_listen_port      = 8774 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] osapi_compute_unique_server_name_scope =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] osapi_compute_workers          = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] password_length                = 12 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] periodic_enable                = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] periodic_fuzzy_delay           = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] pointer_model                  = ps2mouse {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] preallocate_images             = none {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] publish_errors                 = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] pybasedir                      = /opt/stack/nova {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ram_allocation_ratio           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rate_limit_burst               = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rate_limit_except_level        = CRITICAL {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rate_limit_interval            = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] reboot_timeout                 = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] reclaim_instance_interval      = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] record                         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] reimage_timeout_per_gb         = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] report_interval                = 120 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rescue_timeout                 = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] reserved_host_cpus             = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] reserved_host_disk_mb          = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] reserved_host_memory_mb        = 512 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] reserved_huge_pages            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] resize_confirm_window          = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] resize_fs_using_block_device   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] resume_guests_state_on_host_boot = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rpc_response_timeout           = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] run_external_periodic_tasks    = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] running_deleted_instance_action = reap {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] running_deleted_instance_poll_interval = 1800 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] running_deleted_instance_timeout = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler_instance_sync_interval = 120 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_down_time              = 720 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] servicegroup_driver            = db {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] shelved_offload_time           = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] shelved_poll_interval          = 3600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] shutdown_timeout               = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] source_is_ipv6                 = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ssl_only                       = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] state_path                     = /opt/stack/data/nova {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] sync_power_state_interval      = 600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] sync_power_state_pool_size     = 1000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] syslog_log_facility            = LOG_USER {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] tempdir                        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] timeout_nbd                    = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] transport_url                  = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] update_resources_interval      = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] use_cow_images                 = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] use_eventlog                   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] use_journal                    = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] use_json                       = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] use_rootwrap_daemon            = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] use_stderr                     = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] use_syslog                     = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vcpu_pin_set                   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plugging_is_fatal          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plugging_timeout           = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] virt_mkfs                      = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] volume_usage_poll_interval     = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] watch_log_file                 = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] web                            = /usr/share/spice-html5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_concurrency.disable_process_locking = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.auth_strategy              = keystone {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.compute_link_prefix        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.dhcp_domain                = novalocal {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.enable_instance_password   = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.glance_link_prefix         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.instance_list_per_project_cells = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.list_records_by_skipping_down_cells = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.local_metadata_per_cell    = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.max_limit                  = 1000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.metadata_cache_expiration  = 15 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.neutron_default_tenant_id  = default {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.use_forwarded_for          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.use_neutron_default_nets   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.vendordata_dynamic_targets = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.vendordata_jsonfile_path   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.backend                  = dogpile.cache.memcached {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.backend_argument         = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.config_prefix            = cache.oslo {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.dead_timeout             = 60.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.debug_cache_backend      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.enable_retry_client      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.enable_socket_keepalive  = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.enabled                  = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.expiration_time          = 600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.hashclient_retry_attempts = 2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_dead_retry      = 300 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_password        =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_pool_maxsize    = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_sasl_enabled    = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.memcache_username        =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.proxies                  = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.retry_attempts           = 2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.retry_delay              = 0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.socket_keepalive_count   = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.socket_keepalive_idle    = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.socket_keepalive_interval = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.tls_allowed_ciphers      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.tls_cafile               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.tls_certfile             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.tls_enabled              = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cache.tls_keyfile              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.auth_section            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.auth_type               = password {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.cafile                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.certfile                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.collect_timing          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.cross_az_attach         = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.debug                   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.endpoint_template       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.http_retries            = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.insecure                = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.keyfile                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.os_region_name          = RegionOne {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.split_loggers           = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cinder.timeout                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.cpu_dedicated_set      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.cpu_shared_set         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.image_type_exclude_list = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.max_concurrent_disk_ops = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.max_disk_devices_to_attach = -1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.resource_provider_association_refresh = 300 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.shutdown_retry_interval = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] conductor.workers              = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] console.allowed_origins        = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] console.ssl_ciphers            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] console.ssl_minimum_version    = default {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] consoleauth.token_ttl          = 600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.cafile                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.certfile                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.collect_timing          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.connect_retries         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.connect_retry_delay     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.endpoint_override       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.insecure                = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.keyfile                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.max_version             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.min_version             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.region_name             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.service_name            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.service_type            = accelerator {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.split_loggers           = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.status_code_retries     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.status_code_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.timeout                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:35 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] cyborg.version                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.backend               = sqlalchemy {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.connection            = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.connection_debug      = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.connection_parameters =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.connection_recycle_time = 3600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.connection_trace      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.db_inc_retry_interval = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.db_max_retries        = 20 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.db_max_retry_interval = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.db_retry_interval     = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.max_overflow          = 50 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.max_pool_size         = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.max_retries           = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.mysql_wsrep_sync_wait = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.pool_timeout          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.retry_interval        = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.slave_connection      = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] database.sqlite_synchronous    = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.backend           = sqlalchemy {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.connection        = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.connection_debug  = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.connection_parameters =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.connection_recycle_time = 3600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.connection_trace  = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.db_inc_retry_interval = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.db_max_retries    = 20 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.db_max_retry_interval = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.db_retry_interval = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.max_overflow      = 50 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.max_pool_size     = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.max_retries       = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.pool_timeout      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.retry_interval    = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.slave_connection  = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] api_database.sqlite_synchronous = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] devices.enabled_mdev_types     = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ephemeral_storage_encryption.enabled = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.api_servers             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.cafile                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.certfile                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.collect_timing          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.connect_retries         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.connect_retry_delay     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.debug                   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.default_trusted_certificate_ids = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.enable_certificate_validation = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.enable_rbd_download     = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.endpoint_override       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.insecure                = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.keyfile                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.max_version             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.min_version             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.num_retries             = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.rbd_ceph_conf           =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.rbd_connect_timeout     = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.rbd_pool                =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.rbd_user                =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.region_name             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.service_name            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.service_type            = image {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.split_loggers           = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.status_code_retries     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.status_code_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.timeout                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.verify_glance_signatures = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] glance.version                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] guestfs.debug                  = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.config_drive_cdrom      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.config_drive_inject_password = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.enable_instance_metrics_collection = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.enable_remotefx         = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.instances_path_share    =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.iscsi_initiator_list    = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.limit_cpu_features      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.power_state_check_timeframe = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.use_multipath_io        = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.volume_attach_retry_count = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.vswitch_name            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] mks.enabled                    = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] image_cache.manager_interval   = 2400 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] image_cache.precache_concurrency = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] image_cache.remove_unused_base_images = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] image_cache.subdirectory_name  = _base {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.api_max_retries         = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.api_retry_interval      = 2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.auth_section            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.auth_type               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.cafile                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.certfile                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.collect_timing          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.conductor_group         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.connect_retries         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.connect_retry_delay     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.endpoint_override       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.insecure                = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.keyfile                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.max_version             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.min_version             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.peer_list               = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.region_name             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.serial_console_state_timeout = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.service_name            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.service_type            = baremetal {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.split_loggers           = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.status_code_retries     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.status_code_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.timeout                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ironic.version                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] key_manager.fixed_key          = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.barbican_api_version  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.barbican_endpoint     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.barbican_endpoint_type = public {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.barbican_region_name  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.cafile                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.certfile              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.collect_timing        = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.insecure              = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.keyfile               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.number_of_retries     = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.retry_delay           = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.send_service_user_token = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.split_loggers         = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.timeout               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.verify_ssl            = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican.verify_ssl_path       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.auth_section = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.auth_type = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.cafile   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.certfile = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.collect_timing = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.insecure = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.keyfile  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.split_loggers = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] barbican_service_user.timeout  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.approle_role_id          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.approle_secret_id        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.cafile                   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.certfile                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.collect_timing           = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.insecure                 = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.keyfile                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.kv_mountpoint            = secret {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.kv_path                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.kv_version               = 2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.namespace                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.root_token_id            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.split_loggers            = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.ssl_ca_crt_file          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.timeout                  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.use_ssl                  = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.auth_section          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.auth_type             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.cafile                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.certfile              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.collect_timing        = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.connect_retries       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.connect_retry_delay   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.endpoint_override     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.insecure              = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.keyfile               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.max_version           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.min_version           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.region_name           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.service_name          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.service_type          = identity {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.split_loggers         = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.status_code_retries   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.status_code_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.timeout               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] keystone.version               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.connection_uri         =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.cpu_mode               = custom {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: WARNING oslo_config.cfg [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.cpu_power_governor_high = performance {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.cpu_power_governor_low = powersave {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.cpu_power_management   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.device_detach_attempts = 8 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.device_detach_timeout  = 20 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.disk_cachemodes        = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.disk_prefix            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.enabled_perf_events    = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.file_backed_memory     = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.gid_maps               = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.hw_disk_discard        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.hw_machine_type        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.images_rbd_glance_store_name =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.images_rbd_pool        = rbd {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.images_type            = default {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.images_volume_group    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.inject_key             = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.inject_partition       = -2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.inject_password        = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.iscsi_iface            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.iser_use_multipath     = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_bandwidth = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_downtime = 500 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_inbound_addr = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_permit_post_copy = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_scheme  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_timeout_action = abort {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_tunnelled = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: WARNING oslo_config.cfg [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 22 15:48:36 user nova-compute[75734]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 22 15:48:36 user nova-compute[75734]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 22 15:48:36 user nova-compute[75734]: and ``live_migration_inbound_addr`` respectively.
Nov 22 15:48:36 user nova-compute[75734]: ).  Its value may be silently ignored in the future.
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.live_migration_with_native_tls = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.max_queues             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.nfs_mount_options      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.num_memory_encrypted_guests = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.num_pcie_ports         = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.pmem_namespaces        = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.quobyte_client_cfg     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rbd_secret_uuid        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rbd_user               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.remote_filesystem_transport = ssh {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rescue_image_id        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rescue_kernel_id       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rescue_ramdisk_id      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.rx_queue_size          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.smbfs_mount_options    =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.snapshot_compression   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.snapshot_image_format  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.sparse_logical_volumes = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.swtpm_enabled          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.swtpm_group            = tss {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.swtpm_user             = tss {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.sysinfo_serial         = unique {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.tb_cache_size          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.tx_queue_size          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.uid_maps               = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.use_virtio_for_bridges = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.virt_type              = kvm {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.volume_clear           = zero {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.volume_clear_size      = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.volume_use_multipath   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.vzstorage_cache_path   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.vzstorage_mount_user   = stack {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.auth_section           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.auth_type              = password {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.cafile                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.certfile               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.collect_timing         = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.connect_retries        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.connect_retry_delay    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.default_floating_pool  = public {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.endpoint_override      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.extension_sync_interval = 600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.http_retries           = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.insecure               = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.keyfile                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.max_version            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.min_version            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.ovs_bridge             = br-int {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.physnets               = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.region_name            = RegionOne {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.service_metadata_proxy = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.service_name           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.service_type           = network {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.split_loggers          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.status_code_retries    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.status_code_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.timeout                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] neutron.version                = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] notifications.bdms_in_notifications = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] notifications.default_level    = INFO {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] notifications.notification_format = unversioned {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] notifications.notify_on_state_change = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] pci.alias                      = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] pci.device_spec                = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] pci.report_in_placement        = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.auth_section         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.auth_type            = password {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.cafile               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.certfile             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.collect_timing       = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.connect_retries      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.connect_retry_delay  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.default_domain_id    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.default_domain_name  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.domain_id            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.domain_name          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.endpoint_override    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.insecure             = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.keyfile              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.max_version          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.min_version          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.password             = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.project_domain_id    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.project_domain_name  = Default {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.project_id           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.project_name         = service {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.region_name          = RegionOne {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.service_name         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.service_type         = placement {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.split_loggers        = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.status_code_retries  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.status_code_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.system_scope         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.timeout              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.trust_id             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.user_domain_id       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.user_domain_name     = Default {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.user_id              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.username             = placement {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] placement.version              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.cores                    = 20 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.count_usage_from_placement = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.injected_file_content_bytes = 10240 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.injected_file_path_length = 255 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.injected_files           = 5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.instances                = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.key_pairs                = 100 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.metadata_items           = 128 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.ram                      = 51200 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.recheck_quota            = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.server_group_members     = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] quota.server_groups            = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rdp.enabled                    = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.image_metadata_prefilter = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.max_attempts         = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.max_placement_results = 1000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.query_placement_for_image_type_support = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] scheduler.workers              = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.host_subset_size = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.isolated_hosts = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.isolated_images = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.pci_in_placement = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.track_instance_changes = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] metrics.required               = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] metrics.weight_multiplier      = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] metrics.weight_setting         = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] serial_console.enabled         = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] serial_console.port_range      = 10000:20000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] serial_console.serialproxy_port = 6083 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.auth_section      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.auth_type         = password {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.cafile            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.certfile          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.collect_timing    = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.insecure          = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.keyfile           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.send_service_user_token = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.split_loggers     = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] service_user.timeout           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.agent_enabled            = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.enabled                  = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.html5proxy_port          = 6082 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.image_compression        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.jpeg_compression         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.playback_compression     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.server_listen            = 127.0.0.1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.streaming_mode           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] spice.zlib_compression         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] upgrade_levels.baseapi         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] upgrade_levels.compute         = auto {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] upgrade_levels.conductor       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] upgrade_levels.scheduler       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.auth_section = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.auth_type = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.cafile = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.certfile = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.insecure = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.keyfile = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vendordata_dynamic_auth.timeout = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.api_retry_count         = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.ca_file                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.cache_prefix            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.cluster_name            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.connection_pool_size    = 10 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.console_delay_seconds   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.datastore_regex         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.host_ip                 = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.host_password           = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.host_port               = 443 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.host_username           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.insecure                = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.integration_bridge      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.maximum_objects         = 100 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.pbm_default_policy      = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.pbm_enabled             = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.pbm_wsdl_location       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.serial_port_proxy_uri   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.serial_port_service_uri = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.task_poll_interval      = 0.5 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.use_linked_clone        = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.vnc_keymap              = en-us {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.vnc_port                = 5900 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vmware.vnc_port_total          = 10000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.auth_schemes               = ['none'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.enabled                    = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.novncproxy_port            = 6080 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.server_listen              = 0.0.0.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.vencrypt_ca_certs          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.vencrypt_client_cert       = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vnc.vencrypt_client_key        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.disable_rootwrap   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.enable_numa_live_migration = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.libvirt_disable_apic = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.client_socket_timeout     = 900 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.default_pool_size         = 1000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.keep_alive                = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.max_header_line           = 16384 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.ssl_ca_file               = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.ssl_cert_file             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.ssl_key_file              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.tcp_keepidle              = 600 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] zvm.ca_file                    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] zvm.cloud_connector_url        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] zvm.reachable_timeout          = 300 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.enforce_new_defaults = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.enforce_scope      = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.policy_default_rule = default {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.policy_file        = policy.yaml {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.connection_string     = messaging:// {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.enabled               = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.es_doc_type           = notification {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.es_scroll_size        = 10000 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.es_scroll_time        = 2m {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.filter_error_trace    = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.hmac_keys             = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.sentinel_service_name = mymaster {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.socket_timeout        = 0.1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.trace_requests        = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler.trace_sqlalchemy      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler_jaeger.process_tags   = {} {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler_jaeger.service_name_prefix = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] profiler_otlp.service_name_prefix = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] remote_debug.host              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] remote_debug.port              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.ssl      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_notifications.retry = -1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.auth_section        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.auth_type           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.cafile              = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.certfile            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.collect_timing      = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.connect_retries     = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.connect_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.endpoint_id         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.endpoint_override   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.insecure            = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.keyfile             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.max_version         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.min_version         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.region_name         = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.service_name        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.service_type        = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.split_loggers       = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.status_code_retries = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.status_code_retry_delay = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.timeout             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.valid_interfaces    = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_limit.version             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_reports.file_event_handler = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] oslo_reports.log_dir           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_ovs_privileged.group  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] vif_plug_ovs_privileged.user   = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.flat_interface = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_ovs.isolate_vif         = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_vif_ovs.per_port_bridge     = False {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] os_brick.lock_path             = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] privsep_osbrick.capabilities   = [21] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] privsep_osbrick.group          = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] privsep_osbrick.helper_command = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] privsep_osbrick.user           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] nova_sys_admin.group           = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] nova_sys_admin.helper_command  = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] nova_sys_admin.user            = None {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG oslo_service.service [None req-81c46ea0-6607-47b2-8c0f-f5688241816c None None] ******************************************************************************** {{(pid=75734) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 22 15:48:36 user nova-compute[75734]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 22 15:48:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Connecting to libvirt: qemu:///system {{(pid=75734) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4ecd0ee2f0> {{(pid=75734) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 22 15:48:36 user nova-compute[75734]: libvirt:  error : internal error: could not initialize domain event timer
Nov 22 15:48:36 user nova-compute[75734]: WARNING nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 22 15:48:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4ecd0ee2f0> {{(pid=75734) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Starting native event thread {{(pid=75734) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Starting green dispatch thread {{(pid=75734) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 22 15:48:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Starting connection event dispatch thread {{(pid=75734) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 22 15:48:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Connection event '1' reason 'None'
Nov 22 15:48:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 22 15:48:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.mount [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Initialising _HostMountState generation 0 {{(pid=75734) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 22 15:48:43 user nova-compute[75734]: INFO nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host capabilities <capabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <host>
Nov 22 15:48:43 user nova-compute[75734]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 22 15:48:43 user nova-compute[75734]:     <cpu>
Nov 22 15:48:43 user nova-compute[75734]:       <arch>x86_64</arch>
Nov 22 15:48:43 user nova-compute[75734]:       <model>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <microcode version='1070'/>
Nov 22 15:48:43 user nova-compute[75734]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 22 15:48:43 user nova-compute[75734]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='osxsave'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='invtsc'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='rsba'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature name='skip-l1dfl-vmentry'/>
Nov 22 15:48:43 user nova-compute[75734]:       <pages unit='KiB' size='4'/>
Nov 22 15:48:43 user nova-compute[75734]:       <pages unit='KiB' size='2048'/>
Nov 22 15:48:43 user nova-compute[75734]:     </cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <power_management>
Nov 22 15:48:43 user nova-compute[75734]:       <suspend_mem/>
Nov 22 15:48:43 user nova-compute[75734]:       <suspend_disk/>
Nov 22 15:48:43 user nova-compute[75734]:       <suspend_hybrid/>
Nov 22 15:48:43 user nova-compute[75734]:     </power_management>
Nov 22 15:48:43 user nova-compute[75734]:     <iommu support='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <migration_features>
Nov 22 15:48:43 user nova-compute[75734]:       <live/>
Nov 22 15:48:43 user nova-compute[75734]:       <uri_transports>
Nov 22 15:48:43 user nova-compute[75734]:         <uri_transport>tcp</uri_transport>
Nov 22 15:48:43 user nova-compute[75734]:         <uri_transport>rdma</uri_transport>
Nov 22 15:48:43 user nova-compute[75734]:       </uri_transports>
Nov 22 15:48:43 user nova-compute[75734]:     </migration_features>
Nov 22 15:48:43 user nova-compute[75734]:     <topology>
Nov 22 15:48:43 user nova-compute[75734]:       <cells num='2'>
Nov 22 15:48:43 user nova-compute[75734]:         <cell id='0'>
Nov 22 15:48:43 user nova-compute[75734]:           <memory unit='KiB'>8189224</memory>
Nov 22 15:48:43 user nova-compute[75734]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 22 15:48:43 user nova-compute[75734]:           <pages unit='KiB' size='2048'>0</pages>
Nov 22 15:48:43 user nova-compute[75734]:           <distances>
Nov 22 15:48:43 user nova-compute[75734]:             <sibling id='0' value='10'/>
Nov 22 15:48:43 user nova-compute[75734]:             <sibling id='1' value='20'/>
Nov 22 15:48:43 user nova-compute[75734]:           </distances>
Nov 22 15:48:43 user nova-compute[75734]:           <cpus num='6'>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 22 15:48:43 user nova-compute[75734]:           </cpus>
Nov 22 15:48:43 user nova-compute[75734]:         </cell>
Nov 22 15:48:43 user nova-compute[75734]:         <cell id='1'>
Nov 22 15:48:43 user nova-compute[75734]:           <memory unit='KiB'>8206460</memory>
Nov 22 15:48:43 user nova-compute[75734]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 22 15:48:43 user nova-compute[75734]:           <pages unit='KiB' size='2048'>0</pages>
Nov 22 15:48:43 user nova-compute[75734]:           <distances>
Nov 22 15:48:43 user nova-compute[75734]:             <sibling id='0' value='20'/>
Nov 22 15:48:43 user nova-compute[75734]:             <sibling id='1' value='10'/>
Nov 22 15:48:43 user nova-compute[75734]:           </distances>
Nov 22 15:48:43 user nova-compute[75734]:           <cpus num='6'>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 22 15:48:43 user nova-compute[75734]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 22 15:48:43 user nova-compute[75734]:           </cpus>
Nov 22 15:48:43 user nova-compute[75734]:         </cell>
Nov 22 15:48:43 user nova-compute[75734]:       </cells>
Nov 22 15:48:43 user nova-compute[75734]:     </topology>
Nov 22 15:48:43 user nova-compute[75734]:     <cache>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 22 15:48:43 user nova-compute[75734]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 22 15:48:43 user nova-compute[75734]:     </cache>
Nov 22 15:48:43 user nova-compute[75734]:     <secmodel>
Nov 22 15:48:43 user nova-compute[75734]:       <model>apparmor</model>
Nov 22 15:48:43 user nova-compute[75734]:       <doi>0</doi>
Nov 22 15:48:43 user nova-compute[75734]:     </secmodel>
Nov 22 15:48:43 user nova-compute[75734]:     <secmodel>
Nov 22 15:48:43 user nova-compute[75734]:       <model>dac</model>
Nov 22 15:48:43 user nova-compute[75734]:       <doi>0</doi>
Nov 22 15:48:43 user nova-compute[75734]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 22 15:48:43 user nova-compute[75734]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 22 15:48:43 user nova-compute[75734]:     </secmodel>
Nov 22 15:48:43 user nova-compute[75734]:   </host>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='alpha'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>clipper</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='armv6l'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>spitz</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>nuri</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>kzm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sx1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>z2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>tosa</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>n810</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>n800</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>terrier</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>midway</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>microbit</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>verdex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>highbank</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>akita</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>connex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>collie</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='armv7l'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>spitz</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>nuri</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>kzm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sx1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>z2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>tosa</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>n810</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>n800</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>terrier</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>midway</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>microbit</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>verdex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>highbank</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>akita</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>connex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>collie</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='aarch64'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>spitz</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>nuri</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>kzm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sx1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>z2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>tosa</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>n810</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>n800</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>terrier</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>midway</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>microbit</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>verdex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>raspi3b</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>highbank</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>akita</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>connex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>collie</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <acpi default='on' toggle='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='cris'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='i686'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>x-remote</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>isapc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>microvm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='kvm'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <pae/>
Nov 22 15:48:43 user nova-compute[75734]:       <nonpae/>
Nov 22 15:48:43 user nova-compute[75734]:       <acpi default='on' toggle='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:       <apic default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='m68k'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>an5206</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>q800</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>next-cube</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='microblaze'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='microblazeel'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='mips'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='16'>malta</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='mipsel'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='16'>malta</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='mips64'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='16'>malta</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>pica61</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>magnum</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='mips64el'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='16'>malta</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>pica61</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>magnum</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='16'>boston</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='ppc'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mac99</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>40p</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>taihu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='ppc64'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2048'>powernv9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>taihu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2048'>powernv10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>40p</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mac99</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2048'>powernv8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='ppc64le'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2048'>powernv9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>taihu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2048'>powernv10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>40p</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>mac99</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2048'>powernv8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='riscv32'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='8'>spike</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>opentitan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='5'>sifive_u</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sifive_e</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='8'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='riscv64'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='8'>spike</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='5'>sifive_u</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>shakti_c</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sifive_e</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='8'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='s390x'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='sh4'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>shix</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>r2d</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='sh4eb'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>shix</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>r2d</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='sparc'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>SS-5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>SS-20</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>LX</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>SS-4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>SS-10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>Voyager</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='sparc64'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sun4u</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>niagara</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>sun4v</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='x86_64'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>64</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>x-remote</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='1'>isapc</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>microvm</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='kvm'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <acpi default='on' toggle='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:       <apic default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='xtensa'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>sim</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>kc705</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>ml605</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx200</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx60</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]:   <guest>
Nov 22 15:48:43 user nova-compute[75734]:     <os_type>hvm</os_type>
Nov 22 15:48:43 user nova-compute[75734]:     <arch name='xtensaeb'>
Nov 22 15:48:43 user nova-compute[75734]:       <wordsize>32</wordsize>
Nov 22 15:48:43 user nova-compute[75734]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='4'>sim</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>kc705</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>ml605</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>virt</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx200</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>lx60</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 22 15:48:43 user nova-compute[75734]:       <domain type='qemu'/>
Nov 22 15:48:43 user nova-compute[75734]:     </arch>
Nov 22 15:48:43 user nova-compute[75734]:     <features>
Nov 22 15:48:43 user nova-compute[75734]:       <cpuselection/>
Nov 22 15:48:43 user nova-compute[75734]:       <deviceboot/>
Nov 22 15:48:43 user nova-compute[75734]:       <disksnapshot default='on' toggle='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     </features>
Nov 22 15:48:43 user nova-compute[75734]:   </guest>
Nov 22 15:48:43 user nova-compute[75734]: </capabilities>
Nov 22 15:48:43 user nova-compute[75734]: 
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-i440fx-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>i686</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='255'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'/>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='lm'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ide</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-i440fx-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>i686</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='255'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'/>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='lm'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ide</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-q35-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>i686</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='288'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'/>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='lm'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-q35-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>i686</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='288'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'/>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='lm'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-i440fx-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>x86_64</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='255'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>efi</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='invtsc'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='rsba'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ide</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-i440fx-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>x86_64</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='255'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>efi</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='invtsc'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='rsba'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ide</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-q35-jammy</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>x86_64</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='288'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>efi</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='invtsc'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='rsba'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 22 15:48:43 user nova-compute[75734]: <domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 15:48:43 user nova-compute[75734]:   <domain>kvm</domain>
Nov 22 15:48:43 user nova-compute[75734]:   <machine>pc-q35-6.2</machine>
Nov 22 15:48:43 user nova-compute[75734]:   <arch>x86_64</arch>
Nov 22 15:48:43 user nova-compute[75734]:   <vcpu max='288'/>
Nov 22 15:48:43 user nova-compute[75734]:   <iothreads supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:   <os supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='firmware'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>efi</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:     <loader supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>rom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pflash</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='readonly'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='secure'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>yes</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>no</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </loader>
Nov 22 15:48:43 user nova-compute[75734]:   </os>
Nov 22 15:48:43 user nova-compute[75734]:   <cpu>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-passthrough' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='hostPassthroughMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='maximum' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='maximumMigratable'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>on</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>off</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='host-model' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <vendor>Intel</vendor>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ss'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='vmx'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pcid'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='hypervisor'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arat'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='umip'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='md-clear'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='invtsc'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibpb'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='ibrs'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-stibp'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='rsba'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='erms'/>
Nov 22 15:48:43 user nova-compute[75734]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:     <mode name='custom' supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>qemu64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>qemu32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>phenom</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>pentium</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>n270</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm64</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>kvm32</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>coreduo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>core2duo</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>athlon</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Westmere</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Snowridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Skylake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>SandyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Penryn</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G5</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G4</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G3</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Opteron_G2</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Opteron_G1</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>IvyBridge</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Icelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Haswell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Rome</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-Milan</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>EPYC</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Dhyana</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cooperlake</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>Conroe</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='no'>Broadwell</model>
Nov 22 15:48:43 user nova-compute[75734]:       <model usable='yes'>486</model>
Nov 22 15:48:43 user nova-compute[75734]:     </mode>
Nov 22 15:48:43 user nova-compute[75734]:   </cpu>
Nov 22 15:48:43 user nova-compute[75734]:   <memoryBacking supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:     <enum name='sourceType'>
Nov 22 15:48:43 user nova-compute[75734]:       <value>file</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>anonymous</value>
Nov 22 15:48:43 user nova-compute[75734]:       <value>memfd</value>
Nov 22 15:48:43 user nova-compute[75734]:     </enum>
Nov 22 15:48:43 user nova-compute[75734]:   </memoryBacking>
Nov 22 15:48:43 user nova-compute[75734]:   <devices>
Nov 22 15:48:43 user nova-compute[75734]:     <disk supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='diskDevice'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>disk</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cdrom</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>floppy</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>lun</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='bus'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>fdc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sata</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </disk>
Nov 22 15:48:43 user nova-compute[75734]:     <graphics supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='type'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>sdl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vnc</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>spice</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egl-headless</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </graphics>
Nov 22 15:48:43 user nova-compute[75734]:     <video supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='modelType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>cirrus</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>vmvga</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>qxl</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>none</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>bochs</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>ramfb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </video>
Nov 22 15:48:43 user nova-compute[75734]:     <hostdev supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='mode'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>subsystem</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='startupPolicy'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>default</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>mandatory</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>requisite</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>optional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='subsysType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>usb</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>pci</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>scsi</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='capsType'/>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='pciBackend'/>
Nov 22 15:48:43 user nova-compute[75734]:     </hostdev>
Nov 22 15:48:43 user nova-compute[75734]:     <rng supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtio-non-transitional</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>random</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>egd</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>builtin</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </rng>
Nov 22 15:48:43 user nova-compute[75734]:     <filesystem supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='driverType'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>path</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>handle</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>virtiofs</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </filesystem>
Nov 22 15:48:43 user nova-compute[75734]:     <tpm supported='yes'>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='model'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-tis</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>tpm-crb</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:       <enum name='backendModel'>
Nov 22 15:48:43 user nova-compute[75734]:         <value>passthrough</value>
Nov 22 15:48:43 user nova-compute[75734]:         <value>emulator</value>
Nov 22 15:48:43 user nova-compute[75734]:       </enum>
Nov 22 15:48:43 user nova-compute[75734]:     </tpm>
Nov 22 15:48:43 user nova-compute[75734]:   </devices>
Nov 22 15:48:43 user nova-compute[75734]:   <features>
Nov 22 15:48:43 user nova-compute[75734]:     <gic supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:     <vmcoreinfo supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <genid supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backingStoreInput supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <backup supported='yes'/>
Nov 22 15:48:43 user nova-compute[75734]:     <sev supported='no'/>
Nov 22 15:48:43 user nova-compute[75734]:   </features>
Nov 22 15:48:43 user nova-compute[75734]: </domainCapabilities>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75734) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75734) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Checking secure boot support for host arch (x86_64) {{(pid=75734) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Checking secure boot support for host arch (x86_64) {{(pid=75734) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Checking secure boot support for host arch (x86_64) {{(pid=75734) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Checking secure boot support for host arch (x86_64) {{(pid=75734) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Checking secure boot support for host arch (x86_64) {{(pid=75734) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 15:48:43 user nova-compute[75734]: INFO nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Secure Boot support detected
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] cpu compare xml: <cpu match="exact">
Nov 22 15:48:43 user nova-compute[75734]:   <model>Nehalem</model>
Nov 22 15:48:43 user nova-compute[75734]: </cpu>
Nov 22 15:48:43 user nova-compute[75734]:  {{(pid=75734) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 22 15:48:43 user nova-compute[75734]: INFO nova.virt.node [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Generated node identity 37d0620c-15f4-4d5b-869d-cafca8d2e0e2
Nov 22 15:48:43 user nova-compute[75734]: INFO nova.virt.node [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Wrote node identity 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 to /opt/stack/data/nova/compute_id
Nov 22 15:48:43 user nova-compute[75734]: WARNING nova.compute.manager [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Compute nodes ['37d0620c-15f4-4d5b-869d-cafca8d2e0e2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 22 15:48:43 user nova-compute[75734]: INFO nova.compute.manager [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 22 15:48:43 user nova-compute[75734]: WARNING nova.compute.manager [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 22 15:48:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:48:43 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:48:44 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:48:44 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Hypervisor/Node resource view: name=user free_ram=11034MB free_disk=26.030494689941406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:48:44 user nova-compute[75734]: WARNING nova.compute.resource_tracker [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] No compute node record for user:37d0620c-15f4-4d5b-869d-cafca8d2e0e2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 could not be found.
Nov 22 15:48:44 user nova-compute[75734]: INFO nova.compute.resource_tracker [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Compute node record created for user:user with uuid: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:48:44 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] [req-38163641-4776-4484-8c2c-24b251d5a315] Created resource provider record via placement API for resource provider with UUID 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 and name user.
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75734) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 22 15:48:44 user nova-compute[75734]: INFO nova.virt.libvirt.host [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] kernel doesn't support AMD SEV
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Libvirt baseline CPU <cpu>
Nov 22 15:48:44 user nova-compute[75734]:   <arch>x86_64</arch>
Nov 22 15:48:44 user nova-compute[75734]:   <model>Nehalem</model>
Nov 22 15:48:44 user nova-compute[75734]:   <vendor>Intel</vendor>
Nov 22 15:48:44 user nova-compute[75734]:   <topology sockets="6" cores="1" threads="1"/>
Nov 22 15:48:44 user nova-compute[75734]: </cpu>
Nov 22 15:48:44 user nova-compute[75734]:  {{(pid=75734) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Updated inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Updating resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 generation from 0 to 1 during operation: update_inventory {{(pid=75734) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Updating resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 generation from 1 to 2 during operation: update_traits {{(pid=75734) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.service [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Creating RPC server for service compute {{(pid=75734) start /opt/stack/nova/nova/service.py:182}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.service [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] Join ServiceGroup membership for this service compute {{(pid=75734) start /opt/stack/nova/nova/service.py:199}}
Nov 22 15:48:44 user nova-compute[75734]: DEBUG nova.servicegroup.drivers.db [None req-c5487de2-9dfd-468c-84b2-acc8b5587cbc None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75734) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:49:40 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:49:41 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:49:41 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:49:41 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=10403MB free_disk=25.93435287475586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:49:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:50:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:50:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:50:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=10419MB free_disk=26.00194549560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:50:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:50:37 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:50:37 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:50:37 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:50:37 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:50:37 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:50:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:50:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:50:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:51:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:51:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:51:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=10383MB free_disk=25.75323486328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:51:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:51:39 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:51:39 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:51:39 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:51:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:51:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:52:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:52:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:52:39 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9705MB free_disk=25.772232055664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:40 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:52:40 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:52:40 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:52:40 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:52:40 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:52:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:52:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:52:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:52:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:52:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:52:52 user nova-compute[75734]: INFO nova.compute.claims [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Claim successful on node user
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:52:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:52:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Creating image(s)
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:52:53 user nova-compute[75734]: INFO nova.compute.claims [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Claim successful on node user
Nov 22 15:52:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG nova.policy [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea603e7c80014f17a76fec19b54443c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963ad36880484ed59f2b34c64a6e450e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG nova.virt.images [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] 9f27db0a-f3d9-4491-93dc-75dd864eab9b was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 15:52:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.part /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.111s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:52:54 user nova-compute[75734]: INFO nova.compute.claims [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Claim successful on node user
Nov 22 15:52:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.part /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.converted" returned: 0 in 0.538s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544.converted --force-share --output=json" returned: 0 in 0.459s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.141s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:54 user nova-compute[75734]: INFO oslo.privsep.daemon [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2kisht6c/privsep.sock']
Nov 22 15:52:54 user nova-compute[75734]: DEBUG nova.policy [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea603e7c80014f17a76fec19b54443c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963ad36880484ed59f2b34c64a6e450e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:52:54 user sudo[85041]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2kisht6c/privsep.sock
Nov 22 15:52:54 user sudo[85041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:52:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Creating image(s)
Nov 22 15:52:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:52:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:52:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Creating image(s)
Nov 22 15:52:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:55 user nova-compute[75734]: DEBUG nova.policy [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dc99ff4c7054545a10673afb2cf930b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234cf12714b74b12aa027c8fff2e784e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:52:56 user sudo[85041]: pam_unix(sudo:session): session closed for user root
Nov 22 15:52:56 user nova-compute[75734]: INFO oslo.privsep.daemon [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Spawned new privsep daemon via rootwrap
Nov 22 15:52:56 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 15:52:56 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 15:52:56 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 22 15:52:56 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85046
Nov 22 15:52:56 user nova-compute[75734]: WARNING oslo_privsep.priv_context [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] privsep daemon already running
Nov 22 15:52:56 user nova-compute[75734]: WARNING oslo_privsep.priv_context [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] privsep daemon already running
Nov 22 15:52:56 user nova-compute[75734]: DEBUG nova.network.neutron [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Successfully created port: e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:52:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.215s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.164s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk 1073741824" returned: 0 in 0.048s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.174s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.201s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Successfully created port: c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.213s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk 1073741824" returned: 0 in 0.058s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.494s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Cannot resize image /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Ensure instance console log exists: /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.166s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.238s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk 1073741824" returned: 0 in 0.054s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Cannot resize image /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Ensure instance console log exists: /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.238s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Cannot resize image /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Ensure instance console log exists: /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:52:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:52:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Successfully created port: 48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:53:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Successfully updated port: e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:53:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:53:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-changed-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Refreshing instance network info cache due to event network-changed-e1881bde-e537-452d-b9f1-697dd0638465. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] Acquiring lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Successfully updated port: c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:53:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance network_info: |[{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] Acquired lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Refreshing network info cache for port e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Start _get_guest_xml network_info=[{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:53:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-124882235',display_name='tempest-ServerRescueNegativeTestJSON-server-124882235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-124882235',id=1,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-dn9irsps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:52:53Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=ee07b591-af40-4c95-9d6a-1ffc82eff086,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.objects.instance [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'pci_devices' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:53:04 user nova-compute[75734]:   <uuid>ee07b591-af40-4c95-9d6a-1ffc82eff086</uuid>
Nov 22 15:53:04 user nova-compute[75734]:   <name>instance-00000001</name>
Nov 22 15:53:04 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:53:04 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:53:04 user nova-compute[75734]:   <metadata>
Nov 22 15:53:04 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:53:04 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:53:04 user nova-compute[75734]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-124882235</nova:name>
Nov 22 15:53:04 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:53:04</nova:creationTime>
Nov 22 15:53:04 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:53:04 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:53:04 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:53:04 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:53:04 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:53:04 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:53:04 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:53:04 user nova-compute[75734]:       <nova:owner>
Nov 22 15:53:04 user nova-compute[75734]:         <nova:user uuid="ea603e7c80014f17a76fec19b54443c9">tempest-ServerRescueNegativeTestJSON-970419785-project-member</nova:user>
Nov 22 15:53:04 user nova-compute[75734]:         <nova:project uuid="963ad36880484ed59f2b34c64a6e450e">tempest-ServerRescueNegativeTestJSON-970419785</nova:project>
Nov 22 15:53:04 user nova-compute[75734]:       </nova:owner>
Nov 22 15:53:04 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:53:04 user nova-compute[75734]:       <nova:ports>
Nov 22 15:53:04 user nova-compute[75734]:         <nova:port uuid="e1881bde-e537-452d-b9f1-697dd0638465">
Nov 22 15:53:04 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 15:53:04 user nova-compute[75734]:         </nova:port>
Nov 22 15:53:04 user nova-compute[75734]:       </nova:ports>
Nov 22 15:53:04 user nova-compute[75734]:     </nova:instance>
Nov 22 15:53:04 user nova-compute[75734]:   </metadata>
Nov 22 15:53:04 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:53:04 user nova-compute[75734]:     <system>
Nov 22 15:53:04 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:53:04 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:53:04 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:53:04 user nova-compute[75734]:       <entry name="serial">ee07b591-af40-4c95-9d6a-1ffc82eff086</entry>
Nov 22 15:53:04 user nova-compute[75734]:       <entry name="uuid">ee07b591-af40-4c95-9d6a-1ffc82eff086</entry>
Nov 22 15:53:04 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:53:04 user nova-compute[75734]:     </system>
Nov 22 15:53:04 user nova-compute[75734]:   </sysinfo>
Nov 22 15:53:04 user nova-compute[75734]:   <os>
Nov 22 15:53:04 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:53:04 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:53:04 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:53:04 user nova-compute[75734]:   </os>
Nov 22 15:53:04 user nova-compute[75734]:   <features>
Nov 22 15:53:04 user nova-compute[75734]:     <acpi/>
Nov 22 15:53:04 user nova-compute[75734]:     <apic/>
Nov 22 15:53:04 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:53:04 user nova-compute[75734]:   </features>
Nov 22 15:53:04 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:53:04 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:53:04 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:53:04 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:53:04 user nova-compute[75734]:   </clock>
Nov 22 15:53:04 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:53:04 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:53:04 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:53:04 user nova-compute[75734]:   </cpu>
Nov 22 15:53:04 user nova-compute[75734]:   <devices>
Nov 22 15:53:04 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:53:04 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:53:04 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk"/>
Nov 22 15:53:04 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:53:04 user nova-compute[75734]:     </disk>
Nov 22 15:53:04 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:53:04 user nova-compute[75734]:       <mac address="fa:16:3e:99:73:52"/>
Nov 22 15:53:04 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:04 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:53:04 user nova-compute[75734]:       <target dev="tape1881bde-e5"/>
Nov 22 15:53:04 user nova-compute[75734]:     </interface>
Nov 22 15:53:04 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:53:04 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/console.log" append="off"/>
Nov 22 15:53:04 user nova-compute[75734]:     </serial>
Nov 22 15:53:04 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:53:04 user nova-compute[75734]:     <video>
Nov 22 15:53:04 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:04 user nova-compute[75734]:     </video>
Nov 22 15:53:04 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:53:04 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:53:04 user nova-compute[75734]:     </rng>
Nov 22 15:53:04 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:53:04 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:53:04 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:53:04 user nova-compute[75734]:     </memballoon>
Nov 22 15:53:04 user nova-compute[75734]:   </devices>
Nov 22 15:53:04 user nova-compute[75734]: </domain>
Nov 22 15:53:04 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-124882235',display_name='tempest-ServerRescueNegativeTestJSON-server-124882235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-124882235',id=1,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-dn9irsps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:52:53Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=ee07b591-af40-4c95-9d6a-1ffc82eff086,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG os_vif [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-changed-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Refreshing instance network info cache due to event network-changed-c3cf56e1-e41c-4bfc-919e-e25bc713c512. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] Acquiring lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Created schema index Interface.name {{(pid=75734) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Created schema index Port.name {{(pid=75734) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Created schema index Bridge.name {{(pid=75734) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [POLLOUT] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ef22137-7094-5b32-ad60-1363fef8c295', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:04 user nova-compute[75734]: INFO oslo.privsep.daemon [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp13ett47t/privsep.sock']
Nov 22 15:53:04 user sudo[85112]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp13ett47t/privsep.sock
Nov 22 15:53:04 user sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updating instance_info_cache with network_info: [{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance network_info: |[{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] Acquired lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Refreshing network info cache for port c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:53:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Start _get_guest_xml network_info=[{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:53:05 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:05 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Successfully updated port: 48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1560752947',display_name='tempest-ServerRescueNegativeTestJSON-server-1560752947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1560752947',id=2,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-cfwznl3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:52:55Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=c9ec4e5a-a31e-470e-9d8b-db2ac4fef115,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.objects.instance [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'pci_devices' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:53:05 user nova-compute[75734]:   <uuid>c9ec4e5a-a31e-470e-9d8b-db2ac4fef115</uuid>
Nov 22 15:53:05 user nova-compute[75734]:   <name>instance-00000002</name>
Nov 22 15:53:05 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:53:05 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:53:05 user nova-compute[75734]:   <metadata>
Nov 22 15:53:05 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:53:05 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:53:05 user nova-compute[75734]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1560752947</nova:name>
Nov 22 15:53:05 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:53:05</nova:creationTime>
Nov 22 15:53:05 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:53:05 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:53:05 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:53:05 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:53:05 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:53:05 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:53:05 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:53:05 user nova-compute[75734]:       <nova:owner>
Nov 22 15:53:05 user nova-compute[75734]:         <nova:user uuid="ea603e7c80014f17a76fec19b54443c9">tempest-ServerRescueNegativeTestJSON-970419785-project-member</nova:user>
Nov 22 15:53:05 user nova-compute[75734]:         <nova:project uuid="963ad36880484ed59f2b34c64a6e450e">tempest-ServerRescueNegativeTestJSON-970419785</nova:project>
Nov 22 15:53:05 user nova-compute[75734]:       </nova:owner>
Nov 22 15:53:05 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:53:05 user nova-compute[75734]:       <nova:ports>
Nov 22 15:53:05 user nova-compute[75734]:         <nova:port uuid="c3cf56e1-e41c-4bfc-919e-e25bc713c512">
Nov 22 15:53:05 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 15:53:05 user nova-compute[75734]:         </nova:port>
Nov 22 15:53:05 user nova-compute[75734]:       </nova:ports>
Nov 22 15:53:05 user nova-compute[75734]:     </nova:instance>
Nov 22 15:53:05 user nova-compute[75734]:   </metadata>
Nov 22 15:53:05 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:53:05 user nova-compute[75734]:     <system>
Nov 22 15:53:05 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:53:05 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:53:05 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:53:05 user nova-compute[75734]:       <entry name="serial">c9ec4e5a-a31e-470e-9d8b-db2ac4fef115</entry>
Nov 22 15:53:05 user nova-compute[75734]:       <entry name="uuid">c9ec4e5a-a31e-470e-9d8b-db2ac4fef115</entry>
Nov 22 15:53:05 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:53:05 user nova-compute[75734]:     </system>
Nov 22 15:53:05 user nova-compute[75734]:   </sysinfo>
Nov 22 15:53:05 user nova-compute[75734]:   <os>
Nov 22 15:53:05 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:53:05 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:53:05 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:53:05 user nova-compute[75734]:   </os>
Nov 22 15:53:05 user nova-compute[75734]:   <features>
Nov 22 15:53:05 user nova-compute[75734]:     <acpi/>
Nov 22 15:53:05 user nova-compute[75734]:     <apic/>
Nov 22 15:53:05 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:53:05 user nova-compute[75734]:   </features>
Nov 22 15:53:05 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:53:05 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:53:05 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:53:05 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:53:05 user nova-compute[75734]:   </clock>
Nov 22 15:53:05 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:53:05 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:53:05 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:53:05 user nova-compute[75734]:   </cpu>
Nov 22 15:53:05 user nova-compute[75734]:   <devices>
Nov 22 15:53:05 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:53:05 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:53:05 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk"/>
Nov 22 15:53:05 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:53:05 user nova-compute[75734]:     </disk>
Nov 22 15:53:05 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:53:05 user nova-compute[75734]:       <mac address="fa:16:3e:fc:ba:b4"/>
Nov 22 15:53:05 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:05 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:53:05 user nova-compute[75734]:       <target dev="tapc3cf56e1-e4"/>
Nov 22 15:53:05 user nova-compute[75734]:     </interface>
Nov 22 15:53:05 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:53:05 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/console.log" append="off"/>
Nov 22 15:53:05 user nova-compute[75734]:     </serial>
Nov 22 15:53:05 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:53:05 user nova-compute[75734]:     <video>
Nov 22 15:53:05 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:05 user nova-compute[75734]:     </video>
Nov 22 15:53:05 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:53:05 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:53:05 user nova-compute[75734]:     </rng>
Nov 22 15:53:05 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:53:05 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:53:05 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:53:05 user nova-compute[75734]:     </memballoon>
Nov 22 15:53:05 user nova-compute[75734]:   </devices>
Nov 22 15:53:05 user nova-compute[75734]: </domain>
Nov 22 15:53:05 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1560752947',display_name='tempest-ServerRescueNegativeTestJSON-server-1560752947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1560752947',id=2,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-cfwznl3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:52:55Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=c9ec4e5a-a31e-470e-9d8b-db2ac4fef115,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG os_vif [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faa7ebc4-afe3-54af-b413-9282c57507da', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:53:06 user sudo[85112]: pam_unix(sudo:session): session closed for user root
Nov 22 15:53:06 user nova-compute[75734]: INFO oslo.privsep.daemon [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Spawned new privsep daemon via rootwrap
Nov 22 15:53:06 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 15:53:06 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 15:53:06 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 22 15:53:06 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85140
Nov 22 15:53:06 user nova-compute[75734]: WARNING oslo_privsep.priv_context [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] privsep daemon already running
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received event network-changed-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Refreshing instance network info cache due to event network-changed-48dbe108-ae0a-4b53-9b51-e28eacc21970. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] Acquiring lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1881bde-e5, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1881bde-e5, col_values=(('qos', UUID('7409cacd-4d54-405c-833f-a701fc263a63')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1881bde-e5, col_values=(('external_ids', {'iface-id': 'e1881bde-e537-452d-b9f1-697dd0638465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:73:52', 'vm-uuid': 'ee07b591-af40-4c95-9d6a-1ffc82eff086'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:06 user nova-compute[75734]: INFO os_vif [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5')
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3cf56e1-e4, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3cf56e1-e4, col_values=(('qos', UUID('b5658fbe-1f60-4369-bbe2-10698cb680d6')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3cf56e1-e4, col_values=(('external_ids', {'iface-id': 'c3cf56e1-e41c-4bfc-919e-e25bc713c512', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:ba:b4', 'vm-uuid': 'c9ec4e5a-a31e-470e-9d8b-db2ac4fef115'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:06 user nova-compute[75734]: INFO os_vif [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4')
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No VIF found with MAC fa:16:3e:99:73:52, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No VIF found with MAC fa:16:3e:fc:ba:b4, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updated VIF entry in instance network info cache for port e1881bde-e537-452d-b9f1-697dd0638465. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-05a0e1b0-4a4d-4ca7-9744-935ab73e6af1 req-e5c01f15-23ab-46e9-936f-5a1749fe75e4 service nova] Releasing lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Instance network_info: |[{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] Acquired lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Refreshing network info cache for port 48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Start _get_guest_xml network_info=[{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:53:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-398780676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-398780676',id=3,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-kal00u5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:52:55Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=fc118db4-cb7d-4887-80c8-853f3f76a33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ca:f8,bridge_name='br-int',has_traffic_filtering=True,id=48dbe108-ae0a-4b53-9b51-e28eacc21970,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbe108-ae') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'pci_devices' on Instance uuid fc118db4-cb7d-4887-80c8-853f3f76a33a {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updated VIF entry in instance network info cache for port c3cf56e1-e41c-4bfc-919e-e25bc713c512. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updating instance_info_cache with network_info: [{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:53:07 user nova-compute[75734]:   <uuid>fc118db4-cb7d-4887-80c8-853f3f76a33a</uuid>
Nov 22 15:53:07 user nova-compute[75734]:   <name>instance-00000003</name>
Nov 22 15:53:07 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:53:07 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:53:07 user nova-compute[75734]:   <metadata>
Nov 22 15:53:07 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:53:07 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:53:07 user nova-compute[75734]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-398780676</nova:name>
Nov 22 15:53:07 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:53:07</nova:creationTime>
Nov 22 15:53:07 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:53:07 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:53:07 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:53:07 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:53:07 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:53:07 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:53:07 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:53:07 user nova-compute[75734]:       <nova:owner>
Nov 22 15:53:07 user nova-compute[75734]:         <nova:user uuid="5dc99ff4c7054545a10673afb2cf930b">tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member</nova:user>
Nov 22 15:53:07 user nova-compute[75734]:         <nova:project uuid="234cf12714b74b12aa027c8fff2e784e">tempest-ServerBootFromVolumeStableRescueTest-1333150873</nova:project>
Nov 22 15:53:07 user nova-compute[75734]:       </nova:owner>
Nov 22 15:53:07 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:53:07 user nova-compute[75734]:       <nova:ports>
Nov 22 15:53:07 user nova-compute[75734]:         <nova:port uuid="48dbe108-ae0a-4b53-9b51-e28eacc21970">
Nov 22 15:53:07 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:53:07 user nova-compute[75734]:         </nova:port>
Nov 22 15:53:07 user nova-compute[75734]:       </nova:ports>
Nov 22 15:53:07 user nova-compute[75734]:     </nova:instance>
Nov 22 15:53:07 user nova-compute[75734]:   </metadata>
Nov 22 15:53:07 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:53:07 user nova-compute[75734]:     <system>
Nov 22 15:53:07 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:53:07 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:53:07 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:53:07 user nova-compute[75734]:       <entry name="serial">fc118db4-cb7d-4887-80c8-853f3f76a33a</entry>
Nov 22 15:53:07 user nova-compute[75734]:       <entry name="uuid">fc118db4-cb7d-4887-80c8-853f3f76a33a</entry>
Nov 22 15:53:07 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:53:07 user nova-compute[75734]:     </system>
Nov 22 15:53:07 user nova-compute[75734]:   </sysinfo>
Nov 22 15:53:07 user nova-compute[75734]:   <os>
Nov 22 15:53:07 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:53:07 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:53:07 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:53:07 user nova-compute[75734]:   </os>
Nov 22 15:53:07 user nova-compute[75734]:   <features>
Nov 22 15:53:07 user nova-compute[75734]:     <acpi/>
Nov 22 15:53:07 user nova-compute[75734]:     <apic/>
Nov 22 15:53:07 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:53:07 user nova-compute[75734]:   </features>
Nov 22 15:53:07 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:53:07 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:53:07 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:53:07 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:53:07 user nova-compute[75734]:   </clock>
Nov 22 15:53:07 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:53:07 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:53:07 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:53:07 user nova-compute[75734]:   </cpu>
Nov 22 15:53:07 user nova-compute[75734]:   <devices>
Nov 22 15:53:07 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:53:07 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:53:07 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk"/>
Nov 22 15:53:07 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:53:07 user nova-compute[75734]:     </disk>
Nov 22 15:53:07 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:53:07 user nova-compute[75734]:       <mac address="fa:16:3e:b7:ca:f8"/>
Nov 22 15:53:07 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:07 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:53:07 user nova-compute[75734]:       <target dev="tap48dbe108-ae"/>
Nov 22 15:53:07 user nova-compute[75734]:     </interface>
Nov 22 15:53:07 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:53:07 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/console.log" append="off"/>
Nov 22 15:53:07 user nova-compute[75734]:     </serial>
Nov 22 15:53:07 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:53:07 user nova-compute[75734]:     <video>
Nov 22 15:53:07 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:07 user nova-compute[75734]:     </video>
Nov 22 15:53:07 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:53:07 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:53:07 user nova-compute[75734]:     </rng>
Nov 22 15:53:07 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:53:07 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:53:07 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:53:07 user nova-compute[75734]:     </memballoon>
Nov 22 15:53:07 user nova-compute[75734]:   </devices>
Nov 22 15:53:07 user nova-compute[75734]: </domain>
Nov 22 15:53:07 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-398780676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-398780676',id=3,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-kal00u5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:52:55Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=fc118db4-cb7d-4887-80c8-853f3f76a33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ca:f8,bridge_name='br-int',has_traffic_filtering=True,id=48dbe108-ae0a-4b53-9b51-e28eacc21970,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbe108-ae') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG os_vif [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ca:f8,bridge_name='br-int',has_traffic_filtering=True,id=48dbe108-ae0a-4b53-9b51-e28eacc21970,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbe108-ae') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf49b161-cea2-53ce-b1fc-c87a753d86d1', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:53:07 user nova-compute[75734]: INFO nova.compute.claims [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Claim successful on node user
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48dbe108-ae, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48dbe108-ae, col_values=(('qos', UUID('6ffc2991-2522-46c0-83b7-8b5d1ee5699c')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48dbe108-ae, col_values=(('external_ids', {'iface-id': '48dbe108-ae0a-4b53-9b51-e28eacc21970', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ca:f8', 'vm-uuid': 'fc118db4-cb7d-4887-80c8-853f3f76a33a'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b7251537-8fe7-4e7e-8660-5771ca14ed00 req-d1757722-29c3-4109-ae05-15ff100923d2 service nova] Releasing lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:07 user nova-compute[75734]: INFO os_vif [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ca:f8,bridge_name='br-int',has_traffic_filtering=True,id=48dbe108-ae0a-4b53-9b51-e28eacc21970,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbe108-ae')
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No VIF found with MAC fa:16:3e:b7:ca:f8, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:53:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:53:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Creating image(s)
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "/opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "/opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "/opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG nova.policy [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3fc7f0844ed41488359c1dd43feeb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0495ec21f9b74a2e8d30e58d3ad504ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.221s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk 1073741824" returned: 0 in 0.065s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.164s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updated VIF entry in instance network info cache for port 48dbe108-ae0a-4b53-9b51-e28eacc21970. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Cannot resize image /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Ensure instance console log exists: /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1ae8b954-0f5f-4f2d-81cc-d69728591d31 req-50290e6e-e6c8-4efc-b212-f62354225fcb service nova] Releasing lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:10 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Successfully created port: aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:53:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Successfully updated port: aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquired lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-changed-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Refreshing instance network info cache due to event network-changed-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] Acquiring lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updating instance_info_cache with network_info: [{"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Releasing lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Instance network_info: |[{"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] Acquired lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Refreshing network info cache for port aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Start _get_guest_xml network_info=[{"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:53:13 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:13 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1854515589',display_name='tempest-VolumesAdminNegativeTest-server-1854515589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1854515589',id=4,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCOvlH6VrvD6XiuZu1fBmeIvstyHynMUxraLy+ukgRQHw+GAe4xplmGmp04ftCLZbta3Gd7x1KRzEC+qsIxfOXPwMLqm5eY34n3f8mCIFFzYO0IKLRl/zW29ZmsP53kPQ==',key_name='tempest-keypair-1439040736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0495ec21f9b74a2e8d30e58d3ad504ff',ramdisk_id='',reservation_id='r-swcgzlil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1651481107',owner_user_name='tempest-VolumesAdminNegativeTest-1651481107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7f0844ed41488359c1dd43feeb66',uuid=02833b01-4e0b-404a-8aae-d47fa0ac6794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converting VIF {"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa49cc3d-3e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lazy-loading 'pci_devices' on Instance uuid 02833b01-4e0b-404a-8aae-d47fa0ac6794 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:53:13 user nova-compute[75734]:   <uuid>02833b01-4e0b-404a-8aae-d47fa0ac6794</uuid>
Nov 22 15:53:13 user nova-compute[75734]:   <name>instance-00000004</name>
Nov 22 15:53:13 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:53:13 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:53:13 user nova-compute[75734]:   <metadata>
Nov 22 15:53:13 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:53:13 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:53:13 user nova-compute[75734]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1854515589</nova:name>
Nov 22 15:53:13 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:53:13</nova:creationTime>
Nov 22 15:53:13 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:53:13 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:53:13 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:53:13 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:53:13 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:53:13 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:53:13 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:53:13 user nova-compute[75734]:       <nova:owner>
Nov 22 15:53:13 user nova-compute[75734]:         <nova:user uuid="c3fc7f0844ed41488359c1dd43feeb66">tempest-VolumesAdminNegativeTest-1651481107-project-member</nova:user>
Nov 22 15:53:13 user nova-compute[75734]:         <nova:project uuid="0495ec21f9b74a2e8d30e58d3ad504ff">tempest-VolumesAdminNegativeTest-1651481107</nova:project>
Nov 22 15:53:13 user nova-compute[75734]:       </nova:owner>
Nov 22 15:53:13 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:53:13 user nova-compute[75734]:       <nova:ports>
Nov 22 15:53:13 user nova-compute[75734]:         <nova:port uuid="aa49cc3d-3e41-4da9-ba4a-ed765f2eb485">
Nov 22 15:53:13 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 15:53:13 user nova-compute[75734]:         </nova:port>
Nov 22 15:53:13 user nova-compute[75734]:       </nova:ports>
Nov 22 15:53:13 user nova-compute[75734]:     </nova:instance>
Nov 22 15:53:13 user nova-compute[75734]:   </metadata>
Nov 22 15:53:13 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:53:13 user nova-compute[75734]:     <system>
Nov 22 15:53:13 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:53:13 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:53:13 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:53:13 user nova-compute[75734]:       <entry name="serial">02833b01-4e0b-404a-8aae-d47fa0ac6794</entry>
Nov 22 15:53:13 user nova-compute[75734]:       <entry name="uuid">02833b01-4e0b-404a-8aae-d47fa0ac6794</entry>
Nov 22 15:53:13 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:53:13 user nova-compute[75734]:     </system>
Nov 22 15:53:13 user nova-compute[75734]:   </sysinfo>
Nov 22 15:53:13 user nova-compute[75734]:   <os>
Nov 22 15:53:13 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:53:13 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:53:13 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:53:13 user nova-compute[75734]:   </os>
Nov 22 15:53:13 user nova-compute[75734]:   <features>
Nov 22 15:53:13 user nova-compute[75734]:     <acpi/>
Nov 22 15:53:13 user nova-compute[75734]:     <apic/>
Nov 22 15:53:13 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:53:13 user nova-compute[75734]:   </features>
Nov 22 15:53:13 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:53:13 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:53:13 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:53:13 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:53:13 user nova-compute[75734]:   </clock>
Nov 22 15:53:13 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:53:13 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:53:13 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:53:13 user nova-compute[75734]:   </cpu>
Nov 22 15:53:13 user nova-compute[75734]:   <devices>
Nov 22 15:53:13 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:53:13 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:53:13 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk"/>
Nov 22 15:53:13 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:53:13 user nova-compute[75734]:     </disk>
Nov 22 15:53:13 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:53:13 user nova-compute[75734]:       <mac address="fa:16:3e:2b:1c:be"/>
Nov 22 15:53:13 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:13 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:53:13 user nova-compute[75734]:       <target dev="tapaa49cc3d-3e"/>
Nov 22 15:53:13 user nova-compute[75734]:     </interface>
Nov 22 15:53:13 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:53:13 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/console.log" append="off"/>
Nov 22 15:53:13 user nova-compute[75734]:     </serial>
Nov 22 15:53:13 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:53:13 user nova-compute[75734]:     <video>
Nov 22 15:53:13 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:13 user nova-compute[75734]:     </video>
Nov 22 15:53:13 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:53:13 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:53:13 user nova-compute[75734]:     </rng>
Nov 22 15:53:13 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:53:13 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:53:13 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:53:13 user nova-compute[75734]:     </memballoon>
Nov 22 15:53:13 user nova-compute[75734]:   </devices>
Nov 22 15:53:13 user nova-compute[75734]: </domain>
Nov 22 15:53:13 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1854515589',display_name='tempest-VolumesAdminNegativeTest-server-1854515589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1854515589',id=4,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCOvlH6VrvD6XiuZu1fBmeIvstyHynMUxraLy+ukgRQHw+GAe4xplmGmp04ftCLZbta3Gd7x1KRzEC+qsIxfOXPwMLqm5eY34n3f8mCIFFzYO0IKLRl/zW29ZmsP53kPQ==',key_name='tempest-keypair-1439040736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0495ec21f9b74a2e8d30e58d3ad504ff',ramdisk_id='',reservation_id='r-swcgzlil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1651481107',owner_user_name='tempest-VolumesAdminNegativeTest-1651481107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7f0844ed41488359c1dd43feeb66',uuid=02833b01-4e0b-404a-8aae-d47fa0ac6794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converting VIF {"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa49cc3d-3e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG os_vif [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa49cc3d-3e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance spawned successfully.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffbb04bc-5a1d-5f3f-8e33-42bc69f9808b', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa49cc3d-3e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa49cc3d-3e, col_values=(('qos', UUID('97847c61-1a06-49aa-a5e3-68b355934c77')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa49cc3d-3e, col_values=(('external_ids', {'iface-id': 'aa49cc3d-3e41-4da9-ba4a-ed765f2eb485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:1c:be', 'vm-uuid': '02833b01-4e0b-404a-8aae-d47fa0ac6794'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:13 user nova-compute[75734]: INFO os_vif [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa49cc3d-3e')
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance spawned successfully.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Instance spawned successfully.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] No VIF found with MAC fa:16:3e:2b:1c:be, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Took 20.81 seconds to spawn the instance on the hypervisor.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Took 18.52 seconds to spawn the instance on the hypervisor.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Took 18.34 seconds to spawn the instance on the hypervisor.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.compute.manager [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Took 20.80 seconds to build instance.
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.compute.manager [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Took 22.36 seconds to build instance.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updated VIF entry in instance network info cache for port aa49cc3d-3e41-4da9-ba4a-ed765f2eb485. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updating instance_info_cache with network_info: [{"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3bac0a6d-b2d5-4fff-85cf-a7938e597f85 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.599s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd54f8ad-c0e7-436d-9d5e-99474004a3ea tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.996s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d878306-c5d2-4f72-b5cf-4d7ebf071c46 req-509ea722-aefc-4b96-bcd9-4e76a05509b2 service nova] Releasing lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:13 user nova-compute[75734]: INFO nova.compute.manager [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Took 19.92 seconds to build instance.
Nov 22 15:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c91830de-1ac4-4e51-8b1d-e7d6824f4628 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.084s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-a73b3c78-53a7-4984-af8b-775850179f38 req-755594c7-6c60-474d-8a11-0e5ccfd8ab7a service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a73b3c78-53a7-4984-af8b-775850179f38 req-755594c7-6c60-474d-8a11-0e5ccfd8ab7a service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a73b3c78-53a7-4984-af8b-775850179f38 req-755594c7-6c60-474d-8a11-0e5ccfd8ab7a service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a73b3c78-53a7-4984-af8b-775850179f38 req-755594c7-6c60-474d-8a11-0e5ccfd8ab7a service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-a73b3c78-53a7-4984-af8b-775850179f38 req-755594c7-6c60-474d-8a11-0e5ccfd8ab7a service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:14 user nova-compute[75734]: WARNING nova.compute.manager [req-a73b3c78-53a7-4984-af8b-775850179f38 req-755594c7-6c60-474d-8a11-0e5ccfd8ab7a service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state None.
Nov 22 15:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-3f9df657-3fe0-4612-8dc9-d7479256d1f1 req-86c3a9c6-6627-49e8-b480-aa006d476805 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f9df657-3fe0-4612-8dc9-d7479256d1f1 req-86c3a9c6-6627-49e8-b480-aa006d476805 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f9df657-3fe0-4612-8dc9-d7479256d1f1 req-86c3a9c6-6627-49e8-b480-aa006d476805 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f9df657-3fe0-4612-8dc9-d7479256d1f1 req-86c3a9c6-6627-49e8-b480-aa006d476805 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-3f9df657-3fe0-4612-8dc9-d7479256d1f1 req-86c3a9c6-6627-49e8-b480-aa006d476805 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:16 user nova-compute[75734]: WARNING nova.compute.manager [req-3f9df657-3fe0-4612-8dc9-d7479256d1f1 req-86c3a9c6-6627-49e8-b480-aa006d476805 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state None.
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:53:16 user nova-compute[75734]: INFO nova.compute.claims [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Claim successful on node user
Nov 22 15:53:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-a4dabfb8-07c0-4fb1-a87a-f50111e588b2 req-55a3c1a8-48e3-4f4c-84a4-118f3cf1d4c6 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a4dabfb8-07c0-4fb1-a87a-f50111e588b2 req-55a3c1a8-48e3-4f4c-84a4-118f3cf1d4c6 service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a4dabfb8-07c0-4fb1-a87a-f50111e588b2 req-55a3c1a8-48e3-4f4c-84a4-118f3cf1d4c6 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a4dabfb8-07c0-4fb1-a87a-f50111e588b2 req-55a3c1a8-48e3-4f4c-84a4-118f3cf1d4c6 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-a4dabfb8-07c0-4fb1-a87a-f50111e588b2 req-55a3c1a8-48e3-4f4c-84a4-118f3cf1d4c6 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:16 user nova-compute[75734]: WARNING nova.compute.manager [req-a4dabfb8-07c0-4fb1-a87a-f50111e588b2 req-55a3c1a8-48e3-4f4c-84a4-118f3cf1d4c6 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received unexpected event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with vm_state active and task_state None.
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.817s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:53:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.policy [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d666933fdf74e4e8fad7a7112d1eecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bb98a544c0407bb4629239134c9404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:53:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Creating image(s)
Nov 22 15:53:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "/opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "/opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.273s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.201s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk 1073741824" returned: 0 in 0.071s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:53:18 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Instance spawned successfully.
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Successfully created port: e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.288s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:18 user nova-compute[75734]: INFO nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Took 10.14 seconds to spawn the instance on the hypervisor.
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-acf077fe-d576-468b-9081-afd5491d48fd req-36e0a0f1-e5bd-4ab0-b8ca-045093704d51 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-acf077fe-d576-468b-9081-afd5491d48fd req-36e0a0f1-e5bd-4ab0-b8ca-045093704d51 service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-acf077fe-d576-468b-9081-afd5491d48fd req-36e0a0f1-e5bd-4ab0-b8ca-045093704d51 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-acf077fe-d576-468b-9081-afd5491d48fd req-36e0a0f1-e5bd-4ab0-b8ca-045093704d51 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-acf077fe-d576-468b-9081-afd5491d48fd req-36e0a0f1-e5bd-4ab0-b8ca-045093704d51 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:18 user nova-compute[75734]: WARNING nova.compute.manager [req-acf077fe-d576-468b-9081-afd5491d48fd req-36e0a0f1-e5bd-4ab0-b8ca-045093704d51 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received unexpected event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with vm_state active and task_state None.
Nov 22 15:53:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.388s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Cannot resize image /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:19 user nova-compute[75734]: INFO nova.compute.manager [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Took 11.34 seconds to build instance.
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b11fc4d9-5601-4934-b9a4-469bfc2770a5 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.532s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "c158823f-476c-4691-9191-affa6e302565" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:53:19 user nova-compute[75734]: INFO nova.compute.claims [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Claim successful on node user
Nov 22 15:53:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Successfully updated port: e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquired lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:53:19 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:53:20 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.policy [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ae04e9a5bfa4c4088140b509e449832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08ca1d63bf409ba53a06635e0fdb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Updating instance_info_cache with network_info: [{"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:53:20 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Creating image(s)
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Releasing lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Instance network_info: |[{"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Start _get_guest_xml network_info=[{"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:53:20 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:20 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1127049951',display_name='tempest-TestVolumeSwap-server-1127049951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1127049951',id=5,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAeuO3Wqy8Ay7vtVTVcHL5LWeah0dVmv4cC6mr3B6XvvTAAal1hzvI3GZ5SkasRwPrXszDvLYwJ3O3GVohrUx0bFGSke9w46vqODh7QnaqOKgZUfKKKnN/ytEI45f6Edg==',key_name='tempest-keypair-48993993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68bb98a544c0407bb4629239134c9404',ramdisk_id='',reservation_id='r-o1mmuesy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-535208830',owner_user_name='tempest-TestVolumeSwap-535208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d666933fdf74e4e8fad7a7112d1eecb',uuid=a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Converting VIF {"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:e1:53,bridge_name='br-int',has_traffic_filtering=True,id=e408954b-2896-43b1-a721-32a773a0008c,network=Network(0bae00f6-4943-4f4f-bfcf-8662c8b4a56a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape408954b-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.objects.instance [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lazy-loading 'pci_devices' on Instance uuid a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-1ba7c9d2-6121-447e-bb94-eecc6d0f371f req-1049006c-f6b0-438d-ad14-33a99b321da0 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1ba7c9d2-6121-447e-bb94-eecc6d0f371f req-1049006c-f6b0-438d-ad14-33a99b321da0 service nova] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1ba7c9d2-6121-447e-bb94-eecc6d0f371f req-1049006c-f6b0-438d-ad14-33a99b321da0 service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1ba7c9d2-6121-447e-bb94-eecc6d0f371f req-1049006c-f6b0-438d-ad14-33a99b321da0 service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-1ba7c9d2-6121-447e-bb94-eecc6d0f371f req-1049006c-f6b0-438d-ad14-33a99b321da0 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] No waiting events found dispatching network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:20 user nova-compute[75734]: WARNING nova.compute.manager [req-1ba7c9d2-6121-447e-bb94-eecc6d0f371f req-1049006c-f6b0-438d-ad14-33a99b321da0 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received unexpected event network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 for instance with vm_state active and task_state None.
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:53:20 user nova-compute[75734]:   <uuid>a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e</uuid>
Nov 22 15:53:20 user nova-compute[75734]:   <name>instance-00000005</name>
Nov 22 15:53:20 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:53:20 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:53:20 user nova-compute[75734]:   <metadata>
Nov 22 15:53:20 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:53:20 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:53:20 user nova-compute[75734]:       <nova:name>tempest-TestVolumeSwap-server-1127049951</nova:name>
Nov 22 15:53:20 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:53:20</nova:creationTime>
Nov 22 15:53:20 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:53:20 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:53:20 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:53:20 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:53:20 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:53:20 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:53:20 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:53:20 user nova-compute[75734]:       <nova:owner>
Nov 22 15:53:20 user nova-compute[75734]:         <nova:user uuid="1d666933fdf74e4e8fad7a7112d1eecb">tempest-TestVolumeSwap-535208830-project-member</nova:user>
Nov 22 15:53:20 user nova-compute[75734]:         <nova:project uuid="68bb98a544c0407bb4629239134c9404">tempest-TestVolumeSwap-535208830</nova:project>
Nov 22 15:53:20 user nova-compute[75734]:       </nova:owner>
Nov 22 15:53:20 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:53:20 user nova-compute[75734]:       <nova:ports>
Nov 22 15:53:20 user nova-compute[75734]:         <nova:port uuid="e408954b-2896-43b1-a721-32a773a0008c">
Nov 22 15:53:20 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 15:53:20 user nova-compute[75734]:         </nova:port>
Nov 22 15:53:20 user nova-compute[75734]:       </nova:ports>
Nov 22 15:53:20 user nova-compute[75734]:     </nova:instance>
Nov 22 15:53:20 user nova-compute[75734]:   </metadata>
Nov 22 15:53:20 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:53:20 user nova-compute[75734]:     <system>
Nov 22 15:53:20 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:53:20 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:53:20 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:53:20 user nova-compute[75734]:       <entry name="serial">a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e</entry>
Nov 22 15:53:20 user nova-compute[75734]:       <entry name="uuid">a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e</entry>
Nov 22 15:53:20 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:53:20 user nova-compute[75734]:     </system>
Nov 22 15:53:20 user nova-compute[75734]:   </sysinfo>
Nov 22 15:53:20 user nova-compute[75734]:   <os>
Nov 22 15:53:20 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:53:20 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:53:20 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:53:20 user nova-compute[75734]:   </os>
Nov 22 15:53:20 user nova-compute[75734]:   <features>
Nov 22 15:53:20 user nova-compute[75734]:     <acpi/>
Nov 22 15:53:20 user nova-compute[75734]:     <apic/>
Nov 22 15:53:20 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:53:20 user nova-compute[75734]:   </features>
Nov 22 15:53:20 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:53:20 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:53:20 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:53:20 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:53:20 user nova-compute[75734]:   </clock>
Nov 22 15:53:20 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:53:20 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:53:20 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:53:20 user nova-compute[75734]:   </cpu>
Nov 22 15:53:20 user nova-compute[75734]:   <devices>
Nov 22 15:53:20 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:53:20 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:53:20 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk"/>
Nov 22 15:53:20 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:53:20 user nova-compute[75734]:     </disk>
Nov 22 15:53:20 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:53:20 user nova-compute[75734]:       <mac address="fa:16:3e:07:e1:53"/>
Nov 22 15:53:20 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:20 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:53:20 user nova-compute[75734]:       <target dev="tape408954b-28"/>
Nov 22 15:53:20 user nova-compute[75734]:     </interface>
Nov 22 15:53:20 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:53:20 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/console.log" append="off"/>
Nov 22 15:53:20 user nova-compute[75734]:     </serial>
Nov 22 15:53:20 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:53:20 user nova-compute[75734]:     <video>
Nov 22 15:53:20 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:20 user nova-compute[75734]:     </video>
Nov 22 15:53:20 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:53:20 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:53:20 user nova-compute[75734]:     </rng>
Nov 22 15:53:20 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:53:20 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:53:20 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:53:20 user nova-compute[75734]:     </memballoon>
Nov 22 15:53:20 user nova-compute[75734]:   </devices>
Nov 22 15:53:20 user nova-compute[75734]: </domain>
Nov 22 15:53:20 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1127049951',display_name='tempest-TestVolumeSwap-server-1127049951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1127049951',id=5,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAeuO3Wqy8Ay7vtVTVcHL5LWeah0dVmv4cC6mr3B6XvvTAAal1hzvI3GZ5SkasRwPrXszDvLYwJ3O3GVohrUx0bFGSke9w46vqODh7QnaqOKgZUfKKKnN/ytEI45f6Edg==',key_name='tempest-keypair-48993993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68bb98a544c0407bb4629239134c9404',ramdisk_id='',reservation_id='r-o1mmuesy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-535208830',owner_user_name='tempest-TestVolumeSwap-535208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d666933fdf74e4e8fad7a7112d1eecb',uuid=a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Converting VIF {"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:e1:53,bridge_name='br-int',has_traffic_filtering=True,id=e408954b-2896-43b1-a721-32a773a0008c,network=Network(0bae00f6-4943-4f4f-bfcf-8662c8b4a56a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape408954b-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG os_vif [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e1:53,bridge_name='br-int',has_traffic_filtering=True,id=e408954b-2896-43b1-a721-32a773a0008c,network=Network(0bae00f6-4943-4f4f-bfcf-8662c8b4a56a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape408954b-28') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ab258aa-214e-5677-870a-a2493a0a0fc5', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape408954b-28, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape408954b-28, col_values=(('qos', UUID('7ea7e940-998a-4c82-b390-ddd0e9cc0f08')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape408954b-28, col_values=(('external_ids', {'iface-id': 'e408954b-2896-43b1-a721-32a773a0008c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:e1:53', 'vm-uuid': 'a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.284s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:20 user nova-compute[75734]: INFO os_vif [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e1:53,bridge_name='br-int',has_traffic_filtering=True,id=e408954b-2896-43b1-a721-32a773a0008c,network=Network(0bae00f6-4943-4f4f-bfcf-8662c8b4a56a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape408954b-28')
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.260s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] No VIF found with MAC fa:16:3e:07:e1:53, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-changed-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Refreshing instance network info cache due to event network-changed-e408954b-2896-43b1-a721-32a773a0008c. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] Acquiring lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] Acquired lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG nova.network.neutron [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Refreshing network info cache for port e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk 1073741824" returned: 0 in 0.255s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.524s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.328s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:53:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Cannot resize image /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Ensure instance console log exists: /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Updated VIF entry in instance network info cache for port e408954b-2896-43b1-a721-32a773a0008c. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Updating instance_info_cache with network_info: [{"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-792d251e-3f1c-4dc6-b6d2-2e85556a1b8d req-585f6a4f-3456-4c53-9ed1-90485e667c29 service nova] Releasing lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.network.neutron [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Successfully created port: 22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-f349ca10-d243-483a-88b6-c5beb2b5e2b9 req-a4f5d110-f1df-4ac7-89ae-a82e562790af service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f349ca10-d243-483a-88b6-c5beb2b5e2b9 req-a4f5d110-f1df-4ac7-89ae-a82e562790af service nova] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f349ca10-d243-483a-88b6-c5beb2b5e2b9 req-a4f5d110-f1df-4ac7-89ae-a82e562790af service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f349ca10-d243-483a-88b6-c5beb2b5e2b9 req-a4f5d110-f1df-4ac7-89ae-a82e562790af service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-f349ca10-d243-483a-88b6-c5beb2b5e2b9 req-a4f5d110-f1df-4ac7-89ae-a82e562790af service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] No waiting events found dispatching network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:22 user nova-compute[75734]: WARNING nova.compute.manager [req-f349ca10-d243-483a-88b6-c5beb2b5e2b9 req-a4f5d110-f1df-4ac7-89ae-a82e562790af service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received unexpected event network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 for instance with vm_state active and task_state None.
Nov 22 15:53:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Successfully updated port: 22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquired lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-changed-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Refreshing instance network info cache due to event network-changed-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] Acquiring lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Releasing lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Instance network_info: |[{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] Acquired lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Refreshing network info cache for port 22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Start _get_guest_xml network_info=[{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:53:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converting VIF {"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:10:66,bridge_name='br-int',has_traffic_filtering=True,id=22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5,network=Network(ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d78f0a-27') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.objects.instance [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'pci_devices' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:53:24 user nova-compute[75734]:   <uuid>c158823f-476c-4691-9191-affa6e302565</uuid>
Nov 22 15:53:24 user nova-compute[75734]:   <name>instance-00000006</name>
Nov 22 15:53:24 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:53:24 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:53:24 user nova-compute[75734]:   <metadata>
Nov 22 15:53:24 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:53:24 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:53:24 user nova-compute[75734]:       <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:53:24 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:53:24</nova:creationTime>
Nov 22 15:53:24 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:53:24 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:53:24 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:53:24 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:53:24 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:53:24 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:53:24 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:53:24 user nova-compute[75734]:       <nova:owner>
Nov 22 15:53:24 user nova-compute[75734]:         <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:53:24 user nova-compute[75734]:         <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:53:24 user nova-compute[75734]:       </nova:owner>
Nov 22 15:53:24 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:53:24 user nova-compute[75734]:       <nova:ports>
Nov 22 15:53:24 user nova-compute[75734]:         <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:53:24 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:53:24 user nova-compute[75734]:         </nova:port>
Nov 22 15:53:24 user nova-compute[75734]:       </nova:ports>
Nov 22 15:53:24 user nova-compute[75734]:     </nova:instance>
Nov 22 15:53:24 user nova-compute[75734]:   </metadata>
Nov 22 15:53:24 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:53:24 user nova-compute[75734]:     <system>
Nov 22 15:53:24 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:53:24 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:53:24 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:53:24 user nova-compute[75734]:       <entry name="serial">c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:53:24 user nova-compute[75734]:       <entry name="uuid">c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:53:24 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:53:24 user nova-compute[75734]:     </system>
Nov 22 15:53:24 user nova-compute[75734]:   </sysinfo>
Nov 22 15:53:24 user nova-compute[75734]:   <os>
Nov 22 15:53:24 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:53:24 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:53:24 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:53:24 user nova-compute[75734]:   </os>
Nov 22 15:53:24 user nova-compute[75734]:   <features>
Nov 22 15:53:24 user nova-compute[75734]:     <acpi/>
Nov 22 15:53:24 user nova-compute[75734]:     <apic/>
Nov 22 15:53:24 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:53:24 user nova-compute[75734]:   </features>
Nov 22 15:53:24 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:53:24 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:53:24 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:53:24 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:53:24 user nova-compute[75734]:   </clock>
Nov 22 15:53:24 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:53:24 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:53:24 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:53:24 user nova-compute[75734]:   </cpu>
Nov 22 15:53:24 user nova-compute[75734]:   <devices>
Nov 22 15:53:24 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:53:24 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:53:24 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk"/>
Nov 22 15:53:24 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:53:24 user nova-compute[75734]:     </disk>
Nov 22 15:53:24 user nova-compute[75734]:     <disk type="file" device="cdrom">
Nov 22 15:53:24 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 15:53:24 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config"/>
Nov 22 15:53:24 user nova-compute[75734]:       <target dev="hda" bus="ide"/>
Nov 22 15:53:24 user nova-compute[75734]:     </disk>
Nov 22 15:53:24 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:53:24 user nova-compute[75734]:       <mac address="fa:16:3e:0f:10:66"/>
Nov 22 15:53:24 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:24 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:53:24 user nova-compute[75734]:       <target dev="tap22d78f0a-27"/>
Nov 22 15:53:24 user nova-compute[75734]:     </interface>
Nov 22 15:53:24 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:53:24 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log" append="off"/>
Nov 22 15:53:24 user nova-compute[75734]:     </serial>
Nov 22 15:53:24 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:53:24 user nova-compute[75734]:     <video>
Nov 22 15:53:24 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:24 user nova-compute[75734]:     </video>
Nov 22 15:53:24 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:53:24 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:53:24 user nova-compute[75734]:     </rng>
Nov 22 15:53:24 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:53:24 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:53:24 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:53:24 user nova-compute[75734]:     </memballoon>
Nov 22 15:53:24 user nova-compute[75734]:   </devices>
Nov 22 15:53:24 user nova-compute[75734]: </domain>
Nov 22 15:53:24 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converting VIF {"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:10:66,bridge_name='br-int',has_traffic_filtering=True,id=22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5,network=Network(ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d78f0a-27') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG os_vif [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:10:66,bridge_name='br-int',has_traffic_filtering=True,id=22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5,network=Network(ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d78f0a-27') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06908d9f-92d7-57b5-95dd-10740c3e5296', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] No waiting events found dispatching network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:25 user nova-compute[75734]: WARNING nova.compute.manager [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received unexpected event network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c for instance with vm_state building and task_state spawning.
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] No waiting events found dispatching network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:25 user nova-compute[75734]: WARNING nova.compute.manager [req-f07a3e97-026e-470e-b2e3-712a8c372e98 req-95ca5e91-9328-4c9e-81f2-bdcbaf82eaeb service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received unexpected event network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c for instance with vm_state building and task_state spawning.
Nov 22 15:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22d78f0a-27, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22d78f0a-27, col_values=(('qos', UUID('15dd06ab-ba98-4772-9705-35027d3e4edc')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22d78f0a-27, col_values=(('external_ids', {'iface-id': '22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:10:66', 'vm-uuid': 'c158823f-476c-4691-9191-affa6e302565'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:25 user nova-compute[75734]: INFO os_vif [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:10:66,bridge_name='br-int',has_traffic_filtering=True,id=22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5,network=Network(ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d78f0a-27')
Nov 22 15:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No BDM found with device name hda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No VIF found with MAC fa:16:3e:0f:10:66, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:53:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Using config drive
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Updated VIF entry in instance network info cache for port 22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d5597cc-bf3d-4eae-9144-89a5bdb245c8 req-418b0945-3821-4264-84b8-c8656d950a76 service nova] Releasing lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Creating config drive at /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpan43cesa {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpan43cesa" returned: 0 in 0.053s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:53:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Instance spawned successfully.
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:26 user nova-compute[75734]: INFO nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Took 8.42 seconds to spawn the instance on the hypervisor.
Nov 22 15:53:26 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:53:26 user nova-compute[75734]: INFO nova.compute.manager [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Took 9.88 seconds to build instance.
Nov 22 15:53:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bfcec66d-9055-477a-97a8-24027f72fcce tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.061s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-173a42c1-4ca9-4761-a9bd-5235aaf2b9dd req-d7e2cd81-4d85-41a0-964b-2c146281ea03 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-173a42c1-4ca9-4761-a9bd-5235aaf2b9dd req-d7e2cd81-4d85-41a0-964b-2c146281ea03 service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-173a42c1-4ca9-4761-a9bd-5235aaf2b9dd req-d7e2cd81-4d85-41a0-964b-2c146281ea03 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-173a42c1-4ca9-4761-a9bd-5235aaf2b9dd req-d7e2cd81-4d85-41a0-964b-2c146281ea03 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-173a42c1-4ca9-4761-a9bd-5235aaf2b9dd req-d7e2cd81-4d85-41a0-964b-2c146281ea03 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:27 user nova-compute[75734]: WARNING nova.compute.manager [req-173a42c1-4ca9-4761-a9bd-5235aaf2b9dd req-d7e2cd81-4d85-41a0-964b-2c146281ea03 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received unexpected event network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 for instance with vm_state building and task_state spawning.
Nov 22 15:53:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-082bcfd6-73e6-4ff0-b223-18bd525f6462 req-9d3afd6c-425a-456a-a4bd-6211da6649df service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-082bcfd6-73e6-4ff0-b223-18bd525f6462 req-9d3afd6c-425a-456a-a4bd-6211da6649df service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-082bcfd6-73e6-4ff0-b223-18bd525f6462 req-9d3afd6c-425a-456a-a4bd-6211da6649df service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-082bcfd6-73e6-4ff0-b223-18bd525f6462 req-9d3afd6c-425a-456a-a4bd-6211da6649df service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-082bcfd6-73e6-4ff0-b223-18bd525f6462 req-9d3afd6c-425a-456a-a4bd-6211da6649df service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:29 user nova-compute[75734]: WARNING nova.compute.manager [req-082bcfd6-73e6-4ff0-b223-18bd525f6462 req-9d3afd6c-425a-456a-a4bd-6211da6649df service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received unexpected event network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 for instance with vm_state building and task_state spawning.
Nov 22 15:53:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-4d193483-a803-420a-9e52-fed4c914bd92 req-7a40a663-d79d-4342-a785-bda2480f162d service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received event network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4d193483-a803-420a-9e52-fed4c914bd92 req-7a40a663-d79d-4342-a785-bda2480f162d service nova] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4d193483-a803-420a-9e52-fed4c914bd92 req-7a40a663-d79d-4342-a785-bda2480f162d service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4d193483-a803-420a-9e52-fed4c914bd92 req-7a40a663-d79d-4342-a785-bda2480f162d service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-4d193483-a803-420a-9e52-fed4c914bd92 req-7a40a663-d79d-4342-a785-bda2480f162d service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] No waiting events found dispatching network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:29 user nova-compute[75734]: WARNING nova.compute.manager [req-4d193483-a803-420a-9e52-fed4c914bd92 req-7a40a663-d79d-4342-a785-bda2480f162d service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received unexpected event network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 for instance with vm_state active and task_state None.
Nov 22 15:53:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:53:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c158823f-476c-4691-9191-affa6e302565] Instance spawned successfully.
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:31 user nova-compute[75734]: INFO nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Took 10.86 seconds to spawn the instance on the hypervisor.
Nov 22 15:53:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:53:31 user nova-compute[75734]: INFO nova.compute.manager [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Took 12.10 seconds to build instance.
Nov 22 15:53:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-68dfdd2f-06c9-482f-a78c-61ea15c01fbb tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.338s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-60397b81-e9c1-4eec-bb14-f7590c26dbe8 req-58202b17-28d7-4e4c-8729-7cea3a518919 service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received event network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-60397b81-e9c1-4eec-bb14-f7590c26dbe8 req-58202b17-28d7-4e4c-8729-7cea3a518919 service nova] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-60397b81-e9c1-4eec-bb14-f7590c26dbe8 req-58202b17-28d7-4e4c-8729-7cea3a518919 service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-60397b81-e9c1-4eec-bb14-f7590c26dbe8 req-58202b17-28d7-4e4c-8729-7cea3a518919 service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-60397b81-e9c1-4eec-bb14-f7590c26dbe8 req-58202b17-28d7-4e4c-8729-7cea3a518919 service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] No waiting events found dispatching network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:32 user nova-compute[75734]: WARNING nova.compute.manager [req-60397b81-e9c1-4eec-bb14-f7590c26dbe8 req-58202b17-28d7-4e4c-8729-7cea3a518919 service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received unexpected event network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 for instance with vm_state active and task_state None.
Nov 22 15:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:53:32 user nova-compute[75734]: INFO nova.compute.claims [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Claim successful on node user
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:53:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.policy [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f145597d89594643b0626562bb72b68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3a0dbac556464097ef64a6c78a3e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:53:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Creating image(s)
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "/opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "/opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.244s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.306s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk 1073741824" returned: 0 in 0.072s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Successfully created port: c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.261s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Cannot resize image /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Ensure instance console log exists: /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Successfully updated port: c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquired lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-changed-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Refreshing instance network info cache due to event network-changed-c18f633a-a6fa-40d8-b7af-38fc71569f7e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] Acquiring lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updating instance_info_cache with network_info: [{"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Releasing lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Instance network_info: |[{"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] Acquired lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.neutron [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Refreshing network info cache for port c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Start _get_guest_xml network_info=[{"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 15:53:35 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:35 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1947728599',display_name='tempest-VolumesAssistedSnapshotsTest-server-1947728599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1947728599',id=7,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFVwk0tKHo23AsKEmzzheR8uK9oY7ktvAeVGDQce+wND/1F2bTnmoBjZeQUGACLfpWHQ3U2C75lxz3bkcbS5bKoGzOow/c+x/ief0qF/1ikDjFmEIahDlE49liZWo4tnQ==',key_name='tempest-keypair-1151355296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3a0dbac556464097ef64a6c78a3e72',ramdisk_id='',reservation_id='r-1yit0zqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1989877788',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1989877788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f145597d89594643b0626562bb72b68f',uuid=a0dfd979-e5f5-4ca0-b864-90c12641cfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Converting VIF {"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:70:99,bridge_name='br-int',has_traffic_filtering=True,id=c18f633a-a6fa-40d8-b7af-38fc71569f7e,network=Network(9fce1caf-99e0-4e06-9290-04f2c42cc62a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18f633a-a6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lazy-loading 'pci_devices' on Instance uuid a0dfd979-e5f5-4ca0-b864-90c12641cfe9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:53:35 user nova-compute[75734]:   <uuid>a0dfd979-e5f5-4ca0-b864-90c12641cfe9</uuid>
Nov 22 15:53:35 user nova-compute[75734]:   <name>instance-00000007</name>
Nov 22 15:53:35 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:53:35 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:53:35 user nova-compute[75734]:   <metadata>
Nov 22 15:53:35 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:53:35 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:53:35 user nova-compute[75734]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1947728599</nova:name>
Nov 22 15:53:35 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:53:35</nova:creationTime>
Nov 22 15:53:35 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:53:35 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:53:35 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:53:35 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:53:35 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:53:35 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:53:35 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:53:35 user nova-compute[75734]:       <nova:owner>
Nov 22 15:53:35 user nova-compute[75734]:         <nova:user uuid="f145597d89594643b0626562bb72b68f">tempest-VolumesAssistedSnapshotsTest-1989877788-project-member</nova:user>
Nov 22 15:53:35 user nova-compute[75734]:         <nova:project uuid="4d3a0dbac556464097ef64a6c78a3e72">tempest-VolumesAssistedSnapshotsTest-1989877788</nova:project>
Nov 22 15:53:35 user nova-compute[75734]:       </nova:owner>
Nov 22 15:53:35 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:53:35 user nova-compute[75734]:       <nova:ports>
Nov 22 15:53:35 user nova-compute[75734]:         <nova:port uuid="c18f633a-a6fa-40d8-b7af-38fc71569f7e">
Nov 22 15:53:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 15:53:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:53:35 user nova-compute[75734]:       </nova:ports>
Nov 22 15:53:35 user nova-compute[75734]:     </nova:instance>
Nov 22 15:53:35 user nova-compute[75734]:   </metadata>
Nov 22 15:53:35 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:53:35 user nova-compute[75734]:     <system>
Nov 22 15:53:35 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:53:35 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:53:35 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:53:35 user nova-compute[75734]:       <entry name="serial">a0dfd979-e5f5-4ca0-b864-90c12641cfe9</entry>
Nov 22 15:53:35 user nova-compute[75734]:       <entry name="uuid">a0dfd979-e5f5-4ca0-b864-90c12641cfe9</entry>
Nov 22 15:53:35 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:53:35 user nova-compute[75734]:     </system>
Nov 22 15:53:35 user nova-compute[75734]:   </sysinfo>
Nov 22 15:53:35 user nova-compute[75734]:   <os>
Nov 22 15:53:35 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:53:35 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:53:35 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:53:35 user nova-compute[75734]:   </os>
Nov 22 15:53:35 user nova-compute[75734]:   <features>
Nov 22 15:53:35 user nova-compute[75734]:     <acpi/>
Nov 22 15:53:35 user nova-compute[75734]:     <apic/>
Nov 22 15:53:35 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:53:35 user nova-compute[75734]:   </features>
Nov 22 15:53:35 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:53:35 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:53:35 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:53:35 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:53:35 user nova-compute[75734]:   </clock>
Nov 22 15:53:35 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:53:35 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:53:35 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:53:35 user nova-compute[75734]:   </cpu>
Nov 22 15:53:35 user nova-compute[75734]:   <devices>
Nov 22 15:53:35 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:53:35 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:53:35 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk"/>
Nov 22 15:53:35 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:53:35 user nova-compute[75734]:     </disk>
Nov 22 15:53:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:53:35 user nova-compute[75734]:       <mac address="fa:16:3e:3d:70:99"/>
Nov 22 15:53:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:53:35 user nova-compute[75734]:       <target dev="tapc18f633a-a6"/>
Nov 22 15:53:35 user nova-compute[75734]:     </interface>
Nov 22 15:53:35 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:53:35 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/console.log" append="off"/>
Nov 22 15:53:35 user nova-compute[75734]:     </serial>
Nov 22 15:53:35 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:53:35 user nova-compute[75734]:     <video>
Nov 22 15:53:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:53:35 user nova-compute[75734]:     </video>
Nov 22 15:53:35 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:53:35 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:53:35 user nova-compute[75734]:     </rng>
Nov 22 15:53:35 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:53:35 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:53:35 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:53:35 user nova-compute[75734]:     </memballoon>
Nov 22 15:53:35 user nova-compute[75734]:   </devices>
Nov 22 15:53:35 user nova-compute[75734]: </domain>
Nov 22 15:53:35 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1947728599',display_name='tempest-VolumesAssistedSnapshotsTest-server-1947728599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1947728599',id=7,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFVwk0tKHo23AsKEmzzheR8uK9oY7ktvAeVGDQce+wND/1F2bTnmoBjZeQUGACLfpWHQ3U2C75lxz3bkcbS5bKoGzOow/c+x/ief0qF/1ikDjFmEIahDlE49liZWo4tnQ==',key_name='tempest-keypair-1151355296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3a0dbac556464097ef64a6c78a3e72',ramdisk_id='',reservation_id='r-1yit0zqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1989877788',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1989877788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f145597d89594643b0626562bb72b68f',uuid=a0dfd979-e5f5-4ca0-b864-90c12641cfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Converting VIF {"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:70:99,bridge_name='br-int',has_traffic_filtering=True,id=c18f633a-a6fa-40d8-b7af-38fc71569f7e,network=Network(9fce1caf-99e0-4e06-9290-04f2c42cc62a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18f633a-a6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG os_vif [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:70:99,bridge_name='br-int',has_traffic_filtering=True,id=c18f633a-a6fa-40d8-b7af-38fc71569f7e,network=Network(9fce1caf-99e0-4e06-9290-04f2c42cc62a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18f633a-a6') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0ec6c2a-d4b5-5ff3-980a-2ebd2fe77c23', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc18f633a-a6, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc18f633a-a6, col_values=(('qos', UUID('210621bd-4d11-4ca3-87b0-1702f87358ea')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc18f633a-a6, col_values=(('external_ids', {'iface-id': 'c18f633a-a6fa-40d8-b7af-38fc71569f7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:70:99', 'vm-uuid': 'a0dfd979-e5f5-4ca0-b864-90c12641cfe9'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:35 user nova-compute[75734]: INFO os_vif [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:70:99,bridge_name='br-int',has_traffic_filtering=True,id=c18f633a-a6fa-40d8-b7af-38fc71569f7e,network=Network(9fce1caf-99e0-4e06-9290-04f2c42cc62a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18f633a-a6')
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:53:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] No VIF found with MAC fa:16:3e:3d:70:99, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:53:36 user nova-compute[75734]: DEBUG nova.network.neutron [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updated VIF entry in instance network info cache for port c18f633a-a6fa-40d8-b7af-38fc71569f7e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:53:36 user nova-compute[75734]: DEBUG nova.network.neutron [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updating instance_info_cache with network_info: [{"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb2baf07-e19b-42f6-8aa3-9d6c66084f7f req-b9d5e5c0-ade1-4221-b933-d69cbed81b37 service nova] Releasing lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee226bcb-c7fc-45f7-9710-6924ae2332c0 req-3f2e9380-e5a6-4f7a-822b-870446599407 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee226bcb-c7fc-45f7-9710-6924ae2332c0 req-3f2e9380-e5a6-4f7a-822b-870446599407 service nova] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee226bcb-c7fc-45f7-9710-6924ae2332c0 req-3f2e9380-e5a6-4f7a-822b-870446599407 service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee226bcb-c7fc-45f7-9710-6924ae2332c0 req-3f2e9380-e5a6-4f7a-822b-870446599407 service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee226bcb-c7fc-45f7-9710-6924ae2332c0 req-3f2e9380-e5a6-4f7a-822b-870446599407 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] No waiting events found dispatching network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:37 user nova-compute[75734]: WARNING nova.compute.manager [req-ee226bcb-c7fc-45f7-9710-6924ae2332c0 req-3f2e9380-e5a6-4f7a-822b-870446599407 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received unexpected event network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e for instance with vm_state building and task_state spawning.
Nov 22 15:53:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:39 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:53:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-708d085d-4895-44f8-bd93-00641ce74a5e req-99f63ef9-b00b-4e8b-a23a-05c1b26b4f7d service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-708d085d-4895-44f8-bd93-00641ce74a5e req-99f63ef9-b00b-4e8b-a23a-05c1b26b4f7d service nova] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-708d085d-4895-44f8-bd93-00641ce74a5e req-99f63ef9-b00b-4e8b-a23a-05c1b26b4f7d service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-708d085d-4895-44f8-bd93-00641ce74a5e req-99f63ef9-b00b-4e8b-a23a-05c1b26b4f7d service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-708d085d-4895-44f8-bd93-00641ce74a5e req-99f63ef9-b00b-4e8b-a23a-05c1b26b4f7d service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] No waiting events found dispatching network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:53:40 user nova-compute[75734]: WARNING nova.compute.manager [req-708d085d-4895-44f8-bd93-00641ce74a5e req-99f63ef9-b00b-4e8b-a23a-05c1b26b4f7d service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received unexpected event network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e for instance with vm_state building and task_state spawning.
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:53:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Instance spawned successfully.
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:40 user nova-compute[75734]: INFO nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 22 15:53:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:53:40 user nova-compute[75734]: INFO nova.compute.manager [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Took 7.66 seconds to build instance.
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2447a70b-900c-4245-980b-c6d6ae52a880 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.817s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:44 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:44 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7997MB free_disk=25.590560913085938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c158823f-476c-4691-9191-affa6e302565 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 15:53:44 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.036s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:46 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:53:46 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:53:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:53:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:53:46 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:53:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:53:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:53:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:53:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:56 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:53:57 user nova-compute[75734]: INFO nova.compute.claims [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Claim successful on node user
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:53:57 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:53:57 user nova-compute[75734]: INFO nova.virt.block_device [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Booting with volume dfdef766-3310-4f9d-8d37-07960c0abcb5 at /dev/vda
Nov 22 15:53:57 user nova-compute[75734]: DEBUG nova.policy [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d077e3c6eb942f7a76262ac2d92b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e20d284a3e4c61ac15f148ff7a776c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:53:57 user nova-compute[75734]: DEBUG os_brick.utils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:53:57 user nova-compute[75734]: INFO oslo.privsep.daemon [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdyr82jz0/privsep.sock']
Nov 22 15:53:57 user sudo[86449]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdyr82jz0/privsep.sock
Nov 22 15:53:57 user sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 15:53:58 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully created port: 4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully created port: d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:53:59 user sudo[86449]: pam_unix(sudo:session): session closed for user root
Nov 22 15:53:59 user nova-compute[75734]: INFO oslo.privsep.daemon [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Spawned new privsep daemon via rootwrap
Nov 22 15:53:59 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 15:53:59 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 15:53:59 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 22 15:53:59 user nova-compute[75734]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86452
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeeeb9f-66eb-4ca6-b102-eba3af128dc5]: (2,) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[77235e1f-9323-47a0-b01c-ec53f9ec74df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:53:59 user nova-compute[75734]: WARNING os_brick.initiator.connectors.nvmeof [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a0b045-b4db-4f04-a929-a971df239a80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7855a24-532b-4810-82c5-32356cf89646]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337ee1b-02e8-400b-90cd-6b3fa5105b19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:53:59 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:53:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa301f5f-00cd-454c-96ce-1061a7321cbb]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG os_brick.utils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== get_connector_properties: return (2104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:53:59 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating existing volume attachment record: 2d14471e-1b99-4628-978e-6c7c72084421 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully created port: b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:54:00 user nova-compute[75734]: INFO nova.compute.claims [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Claim successful on node user
Nov 22 15:54:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully created port: f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:54:01 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:54:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:54:01 user nova-compute[75734]: INFO nova.virt.block_device [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Booting with volume 878ca599-df98-46a0-a1d3-8de3d65e6d32 at /dev/vda
Nov 22 15:54:01 user nova-compute[75734]: DEBUG os_brick.utils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ea55a5-aab4-450c-a544-5b3c5a1143f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c0f50-9b24-44b1-a468-1b200f5f41a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[011d6497-fcd7-45b5-ac97-355d4750692c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e0b73c-8391-41aa-ab40-c90d8971719b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:01 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:54:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2deb330-cc63-4dfa-89e5-aca7d0421bd8]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG nova.policy [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1960e1acc3ed440c8b1b3da8a5b38cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f581c58e0e0a4eecb93cc79f06560278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG os_brick.utils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating existing volume attachment record: f887f08c-142a-48ac-be33-c1158f53627e {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:54:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully created port: 0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully updated port: 4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully created port: 39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-4b63078b-be6f-4742-bb3e-5faa6da21972. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:02 user nova-compute[75734]: DEBUG nova.network.neutron [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port 4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:03 user nova-compute[75734]: DEBUG nova.network.neutron [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-854dba73-2f19-4709-9aaf-7229fe3f0600 req-2ff3274d-862d-4902-a443-dd992cbbf4c8 service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully created port: 3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully updated port: 92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-92b60767-112b-4298-8cbd-6d5e913f3a8e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port 92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1b9b26ee-9111-48c0-8b10-97ba5f652257 req-87c00c31-b029-4c0b-ba10-db689455db5b service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully created port: 419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully updated port: 0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-0d9d9b26-7f67-44fb-8242-8cf0169030f5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port 0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully created port: 497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-37d9a18a-23e8-4222-9073-411861364976 req-8ab6a547-89a4-4ef5-8940-fecb9ded5c48 service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully updated port: d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully created port: e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully updated port: b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-d4678086-e1b4-4e83-af50-21261b5c12cc. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:10 user nova-compute[75734]: DEBUG nova.network.neutron [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d1309d23-fe56-4a68-a352-481fd635cb15 req-593a8043-bc20-4b68-90c5-a96420b19400 service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:10 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully updated port: 39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully updated port: f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-b2c85b76-2687-490e-a4fb-60964d4d251a. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:11 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully updated port: a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-39c27525-cf88-4583-8c07-8cdab0cdca27. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port 39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:12 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-f44ead43-8018-4ae5-b91b-ab3a137d98e5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Successfully updated port: 0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-674963be-e6df-4f1e-bd3d-422c411c8671 req-aabb1f6b-29b0-4a12-84c3-8fc21c39ed07 service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-a138724e-1f59-40a4-9e47-a19cc86c196f. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:14 user nova-compute[75734]: DEBUG nova.network.neutron [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully updated port: 5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:14 user nova-compute[75734]: DEBUG nova.network.neutron [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-0eac44a6-a860-41bb-9b1f-31a419beeacb. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully updated port: 3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:15 user nova-compute[75734]: INFO nova.virt.block_device [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Booting with volume 3f398841-16c2-4578-822c-7ac9d8440f67 at /dev/vdb
Nov 22 15:54:15 user nova-compute[75734]: INFO nova.virt.block_device [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Booting with volume b19ba00f-48ad-4766-b7e5-10cdbeba2986 at /dev/vdb
Nov 22 15:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG os_brick.utils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[00168ae3-fbb8-4de1-a67d-afa22b7f4743]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e2427-c589-42b9-a32c-8cbf103c60dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f63485-4252-40b5-a635-265e99624f5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG os_brick.utils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dc1b12-4671-4221-8410-7c2910c7bab7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e8b65-5efe-4395-b2d0-0934478e2ac3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port 5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:16 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[766175da-9e07-46e5-9977-00e4fcbdf83c]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1da7a2e-719d-4de7-b771-ee8e05069198]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating existing volume attachment record: efd922c9-6151-49e5-87f7-789ce266b8f9 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4952fc59-6433-41b6-8993-31ada400b3d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86f15f2-52e4-4adc-9fe3-1e741773f36d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:16 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ab08f-26df-4e64-b5f9-d46b777bb454]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating existing volume attachment record: 8cf20909-a6cc-4ec9-a65a-cda3234202f2 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-3701ba1e-8a6d-4f04-841c-de6e6e7e1060. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port 3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-417a78e9-9d7b-4ada-9331-a0653c0f0400 req-fa4b8e8f-9acb-40e1-9213-5d30b0e0dc6d service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully updated port: 419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-419fbf39-7481-4732-967a-68f6b6b8babb. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port 419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [{"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance network_info: |[{"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port 0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4e15a286-e805-443c-8e33-ac8d1aceb381 req-8bad4341-6d5f-4992-9270-ba371bfea868 service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updated VIF entry in instance network info cache for port 0eac44a6-a860-41bb-9b1f-31a419beeacb. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:54:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [{"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-376b7e1e-28b6-493e-86fb-55e193a05ed7 req-dc0939cb-8333-47ab-a491-6841ddd81696 service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully updated port: 497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Successfully updated port: e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-497f029a-269b-4f86-8af0-20dca2bfea98. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance network_info: |[{"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port 497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:54:22 user nova-compute[75734]: INFO nova.compute.claims [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Claim successful on node user
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updated VIF entry in instance network info cache for port 497f029a-269b-4f86-8af0-20dca2bfea98. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-e4411fda-4320-4391-83d8-8b8f47250ed3. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.network.neutron [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updated VIF entry in instance network info cache for port e4411fda-4320-4391-83d8-8b8f47250ed3. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e379ef09-1c65-41a9-98ef-f6d8fc2f6a19 req-8fb2e2ba-f540-4543-8882-aebafc57897e service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.policy [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c080eee08c34b80ae54aa0ed9893c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8378dfb8a70149df8f2cb392ee80e44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:54:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Creating image(s)
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "/opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "/opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.241s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk 1073741824" returned: 0 in 0.051s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Successfully created port: 4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:54:24 user nova-compute[75734]: INFO nova.virt.block_device [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Booting with volume a19ce674-60f6-4086-9972-f4670cd7d489 at /dev/vdc
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG os_brick.utils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5669f6e8-65ef-42e8-a4b5-ccdf8f9ca2fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b153075-a28a-449a-b1a1-3aeb7254a47e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[70157eef-3de6-4301-be1e-db9ce091dea8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d288ba24-1ba7-47f6-9c47-3361786ecdca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Cannot resize image /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Ensure instance console log exists: /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:24 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8016c4-6745-43c7-ba58-0d1aa4823d58]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG os_brick.utils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating existing volume attachment record: 9847b911-bc47-4e8d-8681-3f4e590cd13a {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Successfully updated port: 4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquired lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-changed-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Refreshing instance network info cache due to event network-changed-4de00436-a2b1-4725-bb63-35109e31d750. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] Acquiring lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.neutron [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updating instance_info_cache with network_info: [{"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Releasing lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Instance network_info: |[{"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] Acquired lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Refreshing network info cache for port 4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Start _get_guest_xml network_info=[{"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:54:25 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:25 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-204290539',display_name='tempest-TestStampPattern-server-204290539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-204290539',id=10,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr2F0xWX4V7cn83ISOfWR0ZWxAnt6203RwWMULSxvl2kcpmW50rLf6b1v+ZQY/JOZAnLEv+bGDYOSPNFyXR/xFl+3u2Yo1jVj5aBO/pRMHr8SQlBV/9R2tVPWk55zdVYA==',key_name='tempest-TestStampPattern-1711431298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8378dfb8a70149df8f2cb392ee80e44f',ramdisk_id='',reservation_id='r-uxdb6g5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2140441883',owner_user_name='tempest-TestStampPattern-2140441883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:23Z,user_data=None,user_id='9c080eee08c34b80ae54aa0ed9893c4c',uuid=9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converting VIF {"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:a7:77,bridge_name='br-int',has_traffic_filtering=True,id=4de00436-a2b1-4725-bb63-35109e31d750,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de00436-a2') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.objects.instance [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:54:25 user nova-compute[75734]:   <uuid>9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3</uuid>
Nov 22 15:54:25 user nova-compute[75734]:   <name>instance-0000000a</name>
Nov 22 15:54:25 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:54:25 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:54:25 user nova-compute[75734]:   <metadata>
Nov 22 15:54:25 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:54:25 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:54:25 user nova-compute[75734]:       <nova:name>tempest-TestStampPattern-server-204290539</nova:name>
Nov 22 15:54:25 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:54:25</nova:creationTime>
Nov 22 15:54:25 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:54:25 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:54:25 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:54:25 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:54:25 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:54:25 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:54:25 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:54:25 user nova-compute[75734]:       <nova:owner>
Nov 22 15:54:25 user nova-compute[75734]:         <nova:user uuid="9c080eee08c34b80ae54aa0ed9893c4c">tempest-TestStampPattern-2140441883-project-member</nova:user>
Nov 22 15:54:25 user nova-compute[75734]:         <nova:project uuid="8378dfb8a70149df8f2cb392ee80e44f">tempest-TestStampPattern-2140441883</nova:project>
Nov 22 15:54:25 user nova-compute[75734]:       </nova:owner>
Nov 22 15:54:25 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:54:25 user nova-compute[75734]:       <nova:ports>
Nov 22 15:54:25 user nova-compute[75734]:         <nova:port uuid="4de00436-a2b1-4725-bb63-35109e31d750">
Nov 22 15:54:25 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 15:54:25 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:25 user nova-compute[75734]:       </nova:ports>
Nov 22 15:54:25 user nova-compute[75734]:     </nova:instance>
Nov 22 15:54:25 user nova-compute[75734]:   </metadata>
Nov 22 15:54:25 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:54:25 user nova-compute[75734]:     <system>
Nov 22 15:54:25 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:54:25 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:54:25 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:54:25 user nova-compute[75734]:       <entry name="serial">9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3</entry>
Nov 22 15:54:25 user nova-compute[75734]:       <entry name="uuid">9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3</entry>
Nov 22 15:54:25 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:54:25 user nova-compute[75734]:     </system>
Nov 22 15:54:25 user nova-compute[75734]:   </sysinfo>
Nov 22 15:54:25 user nova-compute[75734]:   <os>
Nov 22 15:54:25 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:54:25 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:54:25 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:54:25 user nova-compute[75734]:   </os>
Nov 22 15:54:25 user nova-compute[75734]:   <features>
Nov 22 15:54:25 user nova-compute[75734]:     <acpi/>
Nov 22 15:54:25 user nova-compute[75734]:     <apic/>
Nov 22 15:54:25 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:54:25 user nova-compute[75734]:   </features>
Nov 22 15:54:25 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:54:25 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:54:25 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:54:25 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:54:25 user nova-compute[75734]:   </clock>
Nov 22 15:54:25 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:54:25 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:54:25 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:54:25 user nova-compute[75734]:   </cpu>
Nov 22 15:54:25 user nova-compute[75734]:   <devices>
Nov 22 15:54:25 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:54:25 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:54:25 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk"/>
Nov 22 15:54:25 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:54:25 user nova-compute[75734]:     </disk>
Nov 22 15:54:25 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:25 user nova-compute[75734]:       <mac address="fa:16:3e:3f:a7:77"/>
Nov 22 15:54:25 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:25 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:25 user nova-compute[75734]:       <target dev="tap4de00436-a2"/>
Nov 22 15:54:25 user nova-compute[75734]:     </interface>
Nov 22 15:54:25 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:54:25 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/console.log" append="off"/>
Nov 22 15:54:25 user nova-compute[75734]:     </serial>
Nov 22 15:54:25 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:54:25 user nova-compute[75734]:     <video>
Nov 22 15:54:25 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:25 user nova-compute[75734]:     </video>
Nov 22 15:54:25 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:54:25 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:54:25 user nova-compute[75734]:     </rng>
Nov 22 15:54:25 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:54:25 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:54:25 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:54:25 user nova-compute[75734]:     </memballoon>
Nov 22 15:54:25 user nova-compute[75734]:   </devices>
Nov 22 15:54:25 user nova-compute[75734]: </domain>
Nov 22 15:54:25 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-204290539',display_name='tempest-TestStampPattern-server-204290539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-204290539',id=10,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr2F0xWX4V7cn83ISOfWR0ZWxAnt6203RwWMULSxvl2kcpmW50rLf6b1v+ZQY/JOZAnLEv+bGDYOSPNFyXR/xFl+3u2Yo1jVj5aBO/pRMHr8SQlBV/9R2tVPWk55zdVYA==',key_name='tempest-TestStampPattern-1711431298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8378dfb8a70149df8f2cb392ee80e44f',ramdisk_id='',reservation_id='r-uxdb6g5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2140441883',owner_user_name='tempest-TestStampPattern-2140441883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:23Z,user_data=None,user_id='9c080eee08c34b80ae54aa0ed9893c4c',uuid=9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converting VIF {"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:a7:77,bridge_name='br-int',has_traffic_filtering=True,id=4de00436-a2b1-4725-bb63-35109e31d750,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de00436-a2') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG os_vif [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:a7:77,bridge_name='br-int',has_traffic_filtering=True,id=4de00436-a2b1-4725-bb63-35109e31d750,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de00436-a2') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27991d5c-9ebc-5de1-a134-cd5e79caf7ec', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4de00436-a2, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4de00436-a2, col_values=(('qos', UUID('5c1a5153-3d6e-41db-baa2-8e8a812d0707')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4de00436-a2, col_values=(('external_ids', {'iface-id': '4de00436-a2b1-4725-bb63-35109e31d750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:a7:77', 'vm-uuid': '9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:25 user nova-compute[75734]: INFO os_vif [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:a7:77,bridge_name='br-int',has_traffic_filtering=True,id=4de00436-a2b1-4725-bb63-35109e31d750,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de00436-a2')
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No VIF found with MAC fa:16:3e:3f:a7:77, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updated VIF entry in instance network info cache for port 4de00436-a2b1-4725-bb63-35109e31d750. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updating instance_info_cache with network_info: [{"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-801978b3-1cea-44b3-9c02-e461cde1598c req-b0142979-397f-4df4-9c26-b5077529e8b5 service nova] Releasing lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-f071c8d9-cb20-489b-8f4c-cd24e144eadd req-631c3c06-6d3c-4a26-a02f-90b6d05cc88c service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f071c8d9-cb20-489b-8f4c-cd24e144eadd req-631c3c06-6d3c-4a26-a02f-90b6d05cc88c service nova] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f071c8d9-cb20-489b-8f4c-cd24e144eadd req-631c3c06-6d3c-4a26-a02f-90b6d05cc88c service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f071c8d9-cb20-489b-8f4c-cd24e144eadd req-631c3c06-6d3c-4a26-a02f-90b6d05cc88c service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-f071c8d9-cb20-489b-8f4c-cd24e144eadd req-631c3c06-6d3c-4a26-a02f-90b6d05cc88c service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] No waiting events found dispatching network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:27 user nova-compute[75734]: WARNING nova.compute.manager [req-f071c8d9-cb20-489b-8f4c-cd24e144eadd req-631c3c06-6d3c-4a26-a02f-90b6d05cc88c service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received unexpected event network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 for instance with vm_state building and task_state spawning.
Nov 22 15:54:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:28 user nova-compute[75734]: INFO nova.virt.block_device [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Booting with volume fb3e586d-ca8c-475f-8486-0fe169db2890 at /dev/vdc
Nov 22 15:54:28 user nova-compute[75734]: DEBUG os_brick.utils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c42245-6b8f-4af1-9cfd-addf1e27bcf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5865776-6168-4e16-bab9-73d4db517df3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb28449-03a8-41fc-a066-399f74b7405c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183d723-8fe6-4adc-9382-6b89546ee00f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:54:28 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:54:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[955ba541-4f5b-4289-8b2f-a3bde521c339]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG os_brick.utils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:28 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating existing volume attachment record: 51ca227f-2d46-4e85-81d3-e3784f04bdc0 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:54:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Instance spawned successfully.
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-090304d5-38b8-44d1-96b3-97be76010a86 req-bb4cb36d-05bc-472e-919c-d0148ffd55b3 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-090304d5-38b8-44d1-96b3-97be76010a86 req-bb4cb36d-05bc-472e-919c-d0148ffd55b3 service nova] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-090304d5-38b8-44d1-96b3-97be76010a86 req-bb4cb36d-05bc-472e-919c-d0148ffd55b3 service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-090304d5-38b8-44d1-96b3-97be76010a86 req-bb4cb36d-05bc-472e-919c-d0148ffd55b3 service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-090304d5-38b8-44d1-96b3-97be76010a86 req-bb4cb36d-05bc-472e-919c-d0148ffd55b3 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] No waiting events found dispatching network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:29 user nova-compute[75734]: WARNING nova.compute.manager [req-090304d5-38b8-44d1-96b3-97be76010a86 req-bb4cb36d-05bc-472e-919c-d0148ffd55b3 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received unexpected event network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 for instance with vm_state building and task_state spawning.
Nov 22 15:54:29 user nova-compute[75734]: INFO nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 22 15:54:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:54:29 user nova-compute[75734]: INFO nova.compute.manager [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Took 6.77 seconds to build instance.
Nov 22 15:54:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-56dad2a2-3278-4fd3-a65e-3b479ef6c950 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.891s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:54:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Creating image(s)
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Ensure instance console log exists: /opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Start _get_guest_xml network_info=[{"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f887f08c-142a-48ac-be33-c1158f53627e', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIbQSTWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e542b93-4c34-4101-ab33-f4dcf81ae00f', 'attached_at': '', 'detached_at': '', 'volume_id': '878ca599-df98-46a0-a1d3-8de3d65e6d32', 'serial': '878ca599-df98-46a0-a1d3-8de3d65e6d32'}, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '8cf20909-a6cc-4ec9-a65a-cda3234202f2', 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWeaDHuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e542b93-4c34-4101-ab33-f4dcf81ae00f', 'attached_at': '', 'detached_at': '', 'volume_id': 'b19ba00f-48ad-4766-b7e5-10cdbeba2986', 'serial': 'b19ba00f-48ad-4766-b7e5-10cdbeba2986'}, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9847b911-bc47-4e8d-8681-3f4e590cd13a', 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIXAVtiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e542b93-4c34-4101-ab33-f4dcf81ae00f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a19ce674-60f6-4086-9972-f4670cd7d489', 'serial': 'a19ce674-60f6-4086-9972-f4670cd7d489'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:54:31 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:31 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connector [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Factory for ISCSI on None {{(pid=75734) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIbQSTWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:31 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:31 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:31 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4050a4-5bf3-45b9-baa7-7a6d7a6d1cc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:54:31 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0591817-59b7-4e27-afbc-3bf2bef54cdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32] added
Nov 22 15:54:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4efd4e-253a-4bd5-8d78-0362b31ba1b8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272b887-c64b-4c70-845e-bcab72c45c0c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIbQSTWq {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIbQSTWq" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd92d0a-f6b2-4d47-8409-f735a176596e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIbQSTWq'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d53793-8bc1-4afc-875b-b198fd84bc56]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[211a6081-1b76-403f-9b0f-38ab76e6e8ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d12816-5ead-485d-99ff-b9b8548b0641 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d12816-5ead-485d-99ff-b9b8548b0641 (non-flash)
Nov 22 15:54:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d12816-5ead-485d-99ff-b9b8548b0641 (non-flash)
Nov 22 15:54:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[381be512-27e1-40ae-b202-a53dae8f113e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260]
Nov 22 15:54:31 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260] successful.
Nov 22 15:54:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb669aff-4ff9-4afd-a948-e4e5a98f3d37]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa8e87-1408-41f6-a000-1c50628c5667]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d12816-5ead-485d-99ff-b9b8548b0641 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d12816-5ead-485d-99ff-b9b8548b0641 (non-flash)
Nov 22 15:54:32 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d12816-5ead-485d-99ff-b9b8548b0641 (non-flash)
Nov 22 15:54:32 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc0d803-2a40-4de2-a58d-a0eabdd129d2]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIbQSTWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23462306665643932', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462306665643932', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWeaDHuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:33 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1000c493-74e8-4f35-8b03-19f2d9e49b88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:54:33 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce88abad-af81-4138-8857-300866eec113]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986] added
Nov 22 15:54:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc9c228-38cc-46e5-8a6c-86d9d2b0c8ca]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[23510c0e-5299-48ad-a929-55b1ef56926e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWeaDHuX {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWeaDHuX" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ddbb0-81a0-4e44-8316-ffa86516f9cb]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qWeaDHuX'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8c262d-794a-4c0f-aee5-cc4945e54653]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1771155d-f9ab-4389-9c7b-1b3130b3536e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8641ec-3fa2-4a69-b5cb-07b2154b4eca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260]
Nov 22 15:54:33 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260] successful.
Nov 22 15:54:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b703f0e3-4d09-44c5-98f0-4ce178958429]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[52088968-1ab7-45d9-bc7f-d4fb6593cf51]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:33 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:33 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f27ba-0640-489d-b6a0-e07015a412c4]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWeaDHuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26564326439343364', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564326439343364', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIXAVtiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:34 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:34 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:34 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f01d71a-b90b-4bd2-884f-9a089078d03f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:54:34 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa5ec4e-4e7d-4027-b675-682359d7e71f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489] added
Nov 22 15:54:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0585806-0f01-47f9-bb8f-9182f2944e94]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b633763-aa2b-4fd8-b48f-101c060a3a04]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIXAVtiJ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIXAVtiJ" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[24002b6f-837d-4081-9c57-a3f17eef0fdc]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIXAVtiJ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a529e7d-6c5c-4649-b9c1-342ebea5b4ea]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d7623-8504-4851-b5d3-074f0794326b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[62025600-62a6-4f4f-bf50-9fa2342dbaa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260]
Nov 22 15:54:34 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260] successful.
Nov 22 15:54:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f486c-3382-4e76-923c-bbe32c125047]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acdcbc7-62d2-4266-8a41-6632d6b723f6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4de202-7d88-4568-a4c2-6aa000df5800]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:34 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIXAVtiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23039306436353566', 'path': '/dev/sdd'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039306436353566', 'path': '/dev/sdd'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b1:77,bridge_name='br-int',has_traffic_filtering=True,id=39c27525-cf88-4583-8c07-8cdab0cdca27,network=Network(757e9aca-c4b9-467f-8652-2d3bd60bdb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c27525-cf') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=a138724e-1f59-40a4-9e47-a19cc86c196f,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa138724e-1f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e7:ff,bridge_name='br-int',has_traffic_filtering=True,id=5ff4df5f-7b8c-40cf-81a7-a4b4e959c136,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ff4df5f-7b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3701ba1e-8a') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bb:60,bridge_name='br-int',has_traffic_filtering=True,id=419fbf39-7481-4732-967a-68f6b6b8babb,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fbf39-74') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b8:e7,bridge_name='br-int',has_traffic_filtering=True,id=497f029a-269b-4f86-8af0-20dca2bfea98,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497f029a-26') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:54:68,bridge_name='br-int',has_traffic_filtering=True,id=e4411fda-4320-4391-83d8-8b8f47250ed3,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4411fda-43') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e542b93-4c34-4101-ab33-f4dcf81ae00f {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:54:35 user nova-compute[75734]:   <uuid>9e542b93-4c34-4101-ab33-f4dcf81ae00f</uuid>
Nov 22 15:54:35 user nova-compute[75734]:   <name>instance-00000009</name>
Nov 22 15:54:35 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:54:35 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:54:35 user nova-compute[75734]:   <metadata>
Nov 22 15:54:35 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:54:35 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:54:35 user nova-compute[75734]:       <nova:name>tempest-device-tagging-server-1178668050</nova:name>
Nov 22 15:54:35 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:54:31</nova:creationTime>
Nov 22 15:54:35 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:54:35 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:54:35 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:54:35 user nova-compute[75734]:       <nova:owner>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:user uuid="1960e1acc3ed440c8b1b3da8a5b38cfe">tempest-TaggedBootDevicesTest-157696607-project-member</nova:user>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:project uuid="f581c58e0e0a4eecb93cc79f06560278">tempest-TaggedBootDevicesTest-157696607</nova:project>
Nov 22 15:54:35 user nova-compute[75734]:       </nova:owner>
Nov 22 15:54:35 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:54:35 user nova-compute[75734]:       <nova:ports>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:port uuid="39c27525-cf88-4583-8c07-8cdab0cdca27">
Nov 22 15:54:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 15:54:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:port uuid="a138724e-1f59-40a4-9e47-a19cc86c196f">
Nov 22 15:54:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Nov 22 15:54:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:port uuid="5ff4df5f-7b8c-40cf-81a7-a4b4e959c136">
Nov 22 15:54:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
Nov 22 15:54:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:port uuid="3701ba1e-8a6d-4f04-841c-de6e6e7e1060">
Nov 22 15:54:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Nov 22 15:54:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:port uuid="419fbf39-7481-4732-967a-68f6b6b8babb">
Nov 22 15:54:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Nov 22 15:54:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:port uuid="497f029a-269b-4f86-8af0-20dca2bfea98">
Nov 22 15:54:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 22 15:54:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:35 user nova-compute[75734]:         <nova:port uuid="e4411fda-4320-4391-83d8-8b8f47250ed3">
Nov 22 15:54:35 user nova-compute[75734]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 22 15:54:35 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:35 user nova-compute[75734]:       </nova:ports>
Nov 22 15:54:35 user nova-compute[75734]:     </nova:instance>
Nov 22 15:54:35 user nova-compute[75734]:   </metadata>
Nov 22 15:54:35 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:54:35 user nova-compute[75734]:     <system>
Nov 22 15:54:35 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:54:35 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:54:35 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:54:35 user nova-compute[75734]:       <entry name="serial">9e542b93-4c34-4101-ab33-f4dcf81ae00f</entry>
Nov 22 15:54:35 user nova-compute[75734]:       <entry name="uuid">9e542b93-4c34-4101-ab33-f4dcf81ae00f</entry>
Nov 22 15:54:35 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:54:35 user nova-compute[75734]:     </system>
Nov 22 15:54:35 user nova-compute[75734]:   </sysinfo>
Nov 22 15:54:35 user nova-compute[75734]:   <os>
Nov 22 15:54:35 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:54:35 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:54:35 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:54:35 user nova-compute[75734]:   </os>
Nov 22 15:54:35 user nova-compute[75734]:   <features>
Nov 22 15:54:35 user nova-compute[75734]:     <acpi/>
Nov 22 15:54:35 user nova-compute[75734]:     <apic/>
Nov 22 15:54:35 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:54:35 user nova-compute[75734]:   </features>
Nov 22 15:54:35 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:54:35 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:54:35 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:54:35 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:54:35 user nova-compute[75734]:   </clock>
Nov 22 15:54:35 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:54:35 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:54:35 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:54:35 user nova-compute[75734]:   </cpu>
Nov 22 15:54:35 user nova-compute[75734]:   <devices>
Nov 22 15:54:35 user nova-compute[75734]:     <disk type="file" device="cdrom">
Nov 22 15:54:35 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 15:54:35 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f/disk.config"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="hda" bus="ide"/>
Nov 22 15:54:35 user nova-compute[75734]:     </disk>
Nov 22 15:54:35 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:54:35 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:54:35 user nova-compute[75734]:       <source dev="/dev/sdc"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <serial>878ca599-df98-46a0-a1d3-8de3d65e6d32</serial>
Nov 22 15:54:35 user nova-compute[75734]:     </disk>
Nov 22 15:54:35 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:54:35 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:54:35 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <serial>b19ba00f-48ad-4766-b7e5-10cdbeba2986</serial>
Nov 22 15:54:35 user nova-compute[75734]:     </disk>
Nov 22 15:54:35 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:54:35 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:54:35 user nova-compute[75734]:       <source dev="/dev/sdd"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="vdc" bus="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <serial>a19ce674-60f6-4086-9972-f4670cd7d489</serial>
Nov 22 15:54:35 user nova-compute[75734]:     </disk>
Nov 22 15:54:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:35 user nova-compute[75734]:       <mac address="fa:16:3e:9f:b1:77"/>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="tap39c27525-cf"/>
Nov 22 15:54:35 user nova-compute[75734]:     </interface>
Nov 22 15:54:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:35 user nova-compute[75734]:       <mac address="fa:16:3e:d5:b6:d4"/>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="tapa138724e-1f"/>
Nov 22 15:54:35 user nova-compute[75734]:     </interface>
Nov 22 15:54:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:35 user nova-compute[75734]:       <mac address="fa:16:3e:a5:e7:ff"/>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="tap5ff4df5f-7b"/>
Nov 22 15:54:35 user nova-compute[75734]:     </interface>
Nov 22 15:54:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:35 user nova-compute[75734]:       <mac address="fa:16:3e:22:e2:aa"/>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="tap3701ba1e-8a"/>
Nov 22 15:54:35 user nova-compute[75734]:     </interface>
Nov 22 15:54:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:35 user nova-compute[75734]:       <mac address="fa:16:3e:9e:bb:60"/>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="tap419fbf39-74"/>
Nov 22 15:54:35 user nova-compute[75734]:     </interface>
Nov 22 15:54:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:35 user nova-compute[75734]:       <mac address="fa:16:3e:20:b8:e7"/>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="tap497f029a-26"/>
Nov 22 15:54:35 user nova-compute[75734]:     </interface>
Nov 22 15:54:35 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:35 user nova-compute[75734]:       <mac address="fa:16:3e:15:54:68"/>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:35 user nova-compute[75734]:       <target dev="tape4411fda-43"/>
Nov 22 15:54:35 user nova-compute[75734]:     </interface>
Nov 22 15:54:35 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:54:35 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f/console.log" append="off"/>
Nov 22 15:54:35 user nova-compute[75734]:     </serial>
Nov 22 15:54:35 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:54:35 user nova-compute[75734]:     <video>
Nov 22 15:54:35 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:35 user nova-compute[75734]:     </video>
Nov 22 15:54:35 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:54:35 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:54:35 user nova-compute[75734]:     </rng>
Nov 22 15:54:35 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:54:35 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:54:35 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:54:35 user nova-compute[75734]:     </memballoon>
Nov 22 15:54:35 user nova-compute[75734]:   </devices>
Nov 22 15:54:35 user nova-compute[75734]: </domain>
Nov 22 15:54:35 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b1:77,bridge_name='br-int',has_traffic_filtering=True,id=39c27525-cf88-4583-8c07-8cdab0cdca27,network=Network(757e9aca-c4b9-467f-8652-2d3bd60bdb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c27525-cf') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b1:77,bridge_name='br-int',has_traffic_filtering=True,id=39c27525-cf88-4583-8c07-8cdab0cdca27,network=Network(757e9aca-c4b9-467f-8652-2d3bd60bdb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c27525-cf') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ee40029-adf8-5e6b-886b-3c7a9dc4139d', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39c27525-cf, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39c27525-cf, col_values=(('qos', UUID('48f30cd0-c61d-4ff2-a490-25afcce313ff')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39c27525-cf, col_values=(('external_ids', {'iface-id': '39c27525-cf88-4583-8c07-8cdab0cdca27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:b1:77', 'vm-uuid': '9e542b93-4c34-4101-ab33-f4dcf81ae00f'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: INFO os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b1:77,bridge_name='br-int',has_traffic_filtering=True,id=39c27525-cf88-4583-8c07-8cdab0cdca27,network=Network(757e9aca-c4b9-467f-8652-2d3bd60bdb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c27525-cf')
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=a138724e-1f59-40a4-9e47-a19cc86c196f,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa138724e-1f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=a138724e-1f59-40a4-9e47-a19cc86c196f,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa138724e-1f') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25518875-06b7-5290-ad61-5e438b36aec5', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa138724e-1f, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa138724e-1f, col_values=(('qos', UUID('95c03ac9-a620-4d83-ba45-4876114f5545')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa138724e-1f, col_values=(('external_ids', {'iface-id': 'a138724e-1f59-40a4-9e47-a19cc86c196f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:b6:d4', 'vm-uuid': '9e542b93-4c34-4101-ab33-f4dcf81ae00f'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:35 user nova-compute[75734]: INFO os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=a138724e-1f59-40a4-9e47-a19cc86c196f,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa138724e-1f')
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e7:ff,bridge_name='br-int',has_traffic_filtering=True,id=5ff4df5f-7b8c-40cf-81a7-a4b4e959c136,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ff4df5f-7b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e7:ff,bridge_name='br-int',has_traffic_filtering=True,id=5ff4df5f-7b8c-40cf-81a7-a4b4e959c136,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ff4df5f-7b') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de5a8f1c-869e-55a7-9264-7c6c97a16667', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ff4df5f-7b, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ff4df5f-7b, col_values=(('qos', UUID('7db6c982-f978-4f79-b4e2-659d547b1021')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ff4df5f-7b, col_values=(('external_ids', {'iface-id': '5ff4df5f-7b8c-40cf-81a7-a4b4e959c136', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:e7:ff', 'vm-uuid': '9e542b93-4c34-4101-ab33-f4dcf81ae00f'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: INFO os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e7:ff,bridge_name='br-int',has_traffic_filtering=True,id=5ff4df5f-7b8c-40cf-81a7-a4b4e959c136,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ff4df5f-7b')
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3701ba1e-8a') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3701ba1e-8a') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '005ac445-e834-53d0-a3be-70260395d85f', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3701ba1e-8a, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3701ba1e-8a, col_values=(('qos', UUID('65728585-953d-4138-b901-306eabf2ef8e')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3701ba1e-8a, col_values=(('external_ids', {'iface-id': '3701ba1e-8a6d-4f04-841c-de6e6e7e1060', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:e2:aa', 'vm-uuid': '9e542b93-4c34-4101-ab33-f4dcf81ae00f'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: INFO os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3701ba1e-8a')
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bb:60,bridge_name='br-int',has_traffic_filtering=True,id=419fbf39-7481-4732-967a-68f6b6b8babb,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fbf39-74') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bb:60,bridge_name='br-int',has_traffic_filtering=True,id=419fbf39-7481-4732-967a-68f6b6b8babb,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fbf39-74') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '651aa1f6-762b-578c-9fce-ec9630aff4b9', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap419fbf39-74, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap419fbf39-74, col_values=(('qos', UUID('6ae0069b-5dd5-43af-8927-1c53295a4d7f')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap419fbf39-74, col_values=(('external_ids', {'iface-id': '419fbf39-7481-4732-967a-68f6b6b8babb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:bb:60', 'vm-uuid': '9e542b93-4c34-4101-ab33-f4dcf81ae00f'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: INFO os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bb:60,bridge_name='br-int',has_traffic_filtering=True,id=419fbf39-7481-4732-967a-68f6b6b8babb,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fbf39-74')
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b8:e7,bridge_name='br-int',has_traffic_filtering=True,id=497f029a-269b-4f86-8af0-20dca2bfea98,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497f029a-26') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b8:e7,bridge_name='br-int',has_traffic_filtering=True,id=497f029a-269b-4f86-8af0-20dca2bfea98,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497f029a-26') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09b63668-eb00-5946-8ca5-ee2fe9d360aa', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap497f029a-26, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap497f029a-26, col_values=(('qos', UUID('3a37f9dc-2f79-4586-b7af-b13d8087235d')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap497f029a-26, col_values=(('external_ids', {'iface-id': '497f029a-269b-4f86-8af0-20dca2bfea98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:b8:e7', 'vm-uuid': '9e542b93-4c34-4101-ab33-f4dcf81ae00f'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: INFO os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b8:e7,bridge_name='br-int',has_traffic_filtering=True,id=497f029a-269b-4f86-8af0-20dca2bfea98,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497f029a-26')
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:54:68,bridge_name='br-int',has_traffic_filtering=True,id=e4411fda-4320-4391-83d8-8b8f47250ed3,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4411fda-43') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:54:68,bridge_name='br-int',has_traffic_filtering=True,id=e4411fda-4320-4391-83d8-8b8f47250ed3,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4411fda-43') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45b6cdd0-8616-5535-9007-00379c3f3327', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4411fda-43, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4411fda-43, col_values=(('qos', UUID('1c6def00-e123-474b-ab56-a8713425a7b0')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4411fda-43, col_values=(('external_ids', {'iface-id': 'e4411fda-4320-4391-83d8-8b8f47250ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:54:68', 'vm-uuid': '9e542b93-4c34-4101-ab33-f4dcf81ae00f'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:36 user nova-compute[75734]: INFO os_vif [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:54:68,bridge_name='br-int',has_traffic_filtering=True,id=e4411fda-4320-4391-83d8-8b8f47250ed3,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4411fda-43')
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] No BDM found with device name hda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] No VIF found with MAC fa:16:3e:9f:b1:77, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] No VIF found with MAC fa:16:3e:9e:bb:60, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:54:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Using config drive
Nov 22 15:54:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Creating config drive at /opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f/disk.config
Nov 22 15:54:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjifr8wjd {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjifr8wjd" returned: 0 in 0.066s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:54:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Creating image(s)
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Ensure instance console log exists: /opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Start _get_guest_xml network_info=[{"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2d14471e-1b99-4628-978e-6c7c72084421', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nyuOXgMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bacfbd1d-ad11-486f-bd13-08d72c346b73', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfdef766-3310-4f9d-8d37-07960c0abcb5', 'serial': 'dfdef766-3310-4f9d-8d37-07960c0abcb5'}, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'efd922c9-6151-49e5-87f7-789ce266b8f9', 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGdOjIkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bacfbd1d-ad11-486f-bd13-08d72c346b73', 'attached_at': '', 'detached_at': '', 'volume_id': '3f398841-16c2-4578-822c-7ac9d8440f67', 'serial': '3f398841-16c2-4578-822c-7ac9d8440f67'}, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '51ca227f-2d46-4e85-81d3-e3784f04bdc0', 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLgVysJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bacfbd1d-ad11-486f-bd13-08d72c346b73', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb3e586d-ca8c-475f-8486-0fe169db2890', 'serial': 'fb3e586d-ca8c-475f-8486-0fe169db2890'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:54:37 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:37 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nyuOXgMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:37 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:37 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:37 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b28baae-ab87-4fbb-91d1-22cc2cb7c227]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:54:37 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9224e4c4-f006-4f81-a35d-7b3168efafa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5] added
Nov 22 15:54:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44ff55-14c6-444b-87b3-666a42d8da3b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2762756-cc1f-445e-bd34-6c3fe6f0b4c5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nyuOXgMH {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nyuOXgMH" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[321c0417-4f8b-4716-8159-bd0862d1b2bd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nyuOXgMH'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4f749a-54ad-4f1a-8552-6fa3bd678d44]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4494449-37b4-46f5-abcc-f136116201a2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b95eb2-37a5-4450-8e51-36b20783b9be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260]
Nov 22 15:54:37 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260] successful.
Nov 22 15:54:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4052df7-9d88-47c7-ba2b-f41167fb8867]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e4c5da-7023-4713-bd08-8ed385554de1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca4f55-8ba6-4a42-abf5-b3355665e1d3]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nyuOXgMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-0d42b89e-7aa6-4641-b28f-ee2753d1b141 req-a5caedd2-d146-4c83-86c1-018be3293fbd service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0d42b89e-7aa6-4641-b28f-ee2753d1b141 req-a5caedd2-d146-4c83-86c1-018be3293fbd service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0d42b89e-7aa6-4641-b28f-ee2753d1b141 req-a5caedd2-d146-4c83-86c1-018be3293fbd service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0d42b89e-7aa6-4641-b28f-ee2753d1b141 req-a5caedd2-d146-4c83-86c1-018be3293fbd service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-0d42b89e-7aa6-4641-b28f-ee2753d1b141 req-a5caedd2-d146-4c83-86c1-018be3293fbd service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:38 user nova-compute[75734]: WARNING nova.compute.manager [req-0d42b89e-7aa6-4641-b28f-ee2753d1b141 req-a5caedd2-d146-4c83-86c1-018be3293fbd service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 for instance with vm_state building and task_state spawning.
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23766356465316435', 'path': '/dev/sde'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766356465316435', 'path': '/dev/sde'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGdOjIkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:38 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:38 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:38 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed2cf56-c854-425b-8989-c95c01606878]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:54:38 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6dc5d-fd5f-427b-9f37-d04c384ba1cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67] added
Nov 22 15:54:38 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[25973d97-fdb7-4239-ba76-55fa66b3cbcf]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da93a9-d8e9-40c9-abbd-59420a352e5d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGdOjIkQ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGdOjIkQ" returned: 0 in 0.037s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ab1b2-e2ac-46fc-aa14-3ac98ef21fd7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yGdOjIkQ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-e57493e7-7b8f-44f0-883e-5bbd51708d06 req-3e0b2139-aa26-4440-91f3-68d7c802052e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e57493e7-7b8f-44f0-883e-5bbd51708d06 req-3e0b2139-aa26-4440-91f3-68d7c802052e service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e57493e7-7b8f-44f0-883e-5bbd51708d06 req-3e0b2139-aa26-4440-91f3-68d7c802052e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e57493e7-7b8f-44f0-883e-5bbd51708d06 req-3e0b2139-aa26-4440-91f3-68d7c802052e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-e57493e7-7b8f-44f0-883e-5bbd51708d06 req-3e0b2139-aa26-4440-91f3-68d7c802052e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:39 user nova-compute[75734]: WARNING nova.compute.manager [req-e57493e7-7b8f-44f0-883e-5bbd51708d06 req-3e0b2139-aa26-4440-91f3-68d7c802052e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f for instance with vm_state building and task_state spawning.
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01cedda-53c1-4817-8073-c0fefe90be8a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[85068c6c-0ffd-403f-9aae-028cb8ceae81]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-5a95427d-ae60-4865-91d8-ff509a332065 req-cd5d93f0-e5d3-457d-b6af-9130978ef160 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5a95427d-ae60-4865-91d8-ff509a332065 req-cd5d93f0-e5d3-457d-b6af-9130978ef160 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5a95427d-ae60-4865-91d8-ff509a332065 req-cd5d93f0-e5d3-457d-b6af-9130978ef160 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5a95427d-ae60-4865-91d8-ff509a332065 req-cd5d93f0-e5d3-457d-b6af-9130978ef160 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-5a95427d-ae60-4865-91d8-ff509a332065 req-cd5d93f0-e5d3-457d-b6af-9130978ef160 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:39 user nova-compute[75734]: WARNING nova.compute.manager [req-5a95427d-ae60-4865-91d8-ff509a332065 req-cd5d93f0-e5d3-457d-b6af-9130978ef160 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 for instance with vm_state building and task_state spawning.
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --login" returned: 0 in 1.115s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48a16d8-dcbd-4a2d-b306-26e2f77cafd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260]
Nov 22 15:54:40 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260] successful.
Nov 22 15:54:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1eff51-671f-4b3b-bf81-245a6ccab253]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1d3496-06fa-4592-92f1-999c06ed0861]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:54:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.463s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcef2ce-f2e9-4ec2-a4fa-5c135faacaa2]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGdOjIkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:40 user nova-compute[75734]: WARNING nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 for instance with vm_state building and task_state spawning.
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:40 user nova-compute[75734]: WARNING nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb for instance with vm_state building and task_state spawning.
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:40 user nova-compute[75734]: WARNING nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb for instance with vm_state building and task_state spawning.
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:40 user nova-compute[75734]: WARNING nova.compute.manager [req-bd771f77-e7a8-4417-a5ab-6668d61a3057 req-afe0407d-448f-4df9-9203-33c52fb6fcab service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 for instance with vm_state building and task_state spawning.
Nov 22 15:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f for instance with vm_state building and task_state spawning.
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 for instance with vm_state building and task_state spawning.
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING nova.compute.manager [req-264b9171-324e-44d1-a890-f57031fdf3a1 req-9ee04a29-ab5b-4855-8f49-16c339284571 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 for instance with vm_state building and task_state spawning.
Nov 22 15:54:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.530s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== connect_volume: return (2534ms) {'type': 'block', 'scsi_wwn': '23438666561376232', 'path': '/dev/sdf'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438666561376232', 'path': '/dev/sdf'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLgVysJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:54:41 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b30ca-cecd-4ebe-9e09-30eb75164e27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:54:41 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 for instance with vm_state building and task_state spawning.
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 for instance with vm_state building and task_state spawning.
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:41 user nova-compute[75734]: WARNING nova.compute.manager [req-060052a4-d852-42bb-876f-bbf09678b2da req-13c1522f-96b9-4068-a8ab-16a99447c103 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 for instance with vm_state building and task_state spawning.
Nov 22 15:54:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb315b4-a242-415f-891f-145915bea4c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890] added
Nov 22 15:54:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0302dc4-962a-422e-9748-ee8010daf6b1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb740e-448b-47c0-b794-88c5db694169]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBLgVysJ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBLgVysJ" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdac7b8-bb25-48f4-8997-e6673a462b53]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBLgVysJ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[12576905-2b2c-4ec3-a755-eeb965f68c3a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd5a8e-6702-4b3c-be53-b6613b59c93a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9dbbe-5b64-4b6c-9572-908502ea9854]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260]
Nov 22 15:54:41 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260] successful.
Nov 22 15:54:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7cca3b-2a74-422a-a971-47db639d8c77]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[096885bd-ab41-4ed3-9b7a-b6417f1a9a98]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:54:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce52ed51-3fb1-47da-95ef-fe51bdd0d149]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:54:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLgVysJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-3b47db4f-4aa4-41af-a0a0-7ce92d49d275 req-b3b33cae-474f-4096-9795-769e4fefc40c service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3b47db4f-4aa4-41af-a0a0-7ce92d49d275 req-b3b33cae-474f-4096-9795-769e4fefc40c service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3b47db4f-4aa4-41af-a0a0-7ce92d49d275 req-b3b33cae-474f-4096-9795-769e4fefc40c service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3b47db4f-4aa4-41af-a0a0-7ce92d49d275 req-b3b33cae-474f-4096-9795-769e4fefc40c service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-3b47db4f-4aa4-41af-a0a0-7ce92d49d275 req-b3b33cae-474f-4096-9795-769e4fefc40c service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:42 user nova-compute[75734]: WARNING nova.compute.manager [req-3b47db4f-4aa4-41af-a0a0-7ce92d49d275 req-b3b33cae-474f-4096-9795-769e4fefc40c service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 for instance with vm_state building and task_state spawning.
Nov 22 15:54:42 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23062323730373435', 'path': '/dev/sdg'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:54:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062323730373435', 'path': '/dev/sdg'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=4b63078b-be6f-4742-bb3e-5faa6da21972,network=Network(bb6bc1e9-65ae-45cf-906f-27617ec8fb67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63078b-be') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=92b60767-112b-4298-8cbd-6d5e913f3a8e,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92b60767-11') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=0d9d9b26-7f67-44fb-8242-8cf0169030f5,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0d9d9b26-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:15:01,bridge_name='br-int',has_traffic_filtering=True,id=d4678086-e1b4-4e83-af50-21261b5c12cc,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4678086-e1') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a5:75,bridge_name='br-int',has_traffic_filtering=True,id=b2c85b76-2687-490e-a4fb-60964d4d251a,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c85b76-26') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:4e,bridge_name='br-int',has_traffic_filtering=True,id=f44ead43-8018-4ae5-b91b-ab3a137d98e5,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf44ead43-80') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:52:36,bridge_name='br-int',has_traffic_filtering=True,id=0eac44a6-a860-41bb-9b1f-31a419beeacb,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac44a6-a8') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.objects.instance [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lazy-loading 'pci_devices' on Instance uuid bacfbd1d-ad11-486f-bd13-08d72c346b73 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:54:43 user nova-compute[75734]:   <uuid>bacfbd1d-ad11-486f-bd13-08d72c346b73</uuid>
Nov 22 15:54:43 user nova-compute[75734]:   <name>instance-00000008</name>
Nov 22 15:54:43 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:54:43 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:54:43 user nova-compute[75734]:   <metadata>
Nov 22 15:54:43 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:54:43 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:54:43 user nova-compute[75734]:       <nova:name>tempest-device-tagging-server-74135548</nova:name>
Nov 22 15:54:43 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:54:37</nova:creationTime>
Nov 22 15:54:43 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:54:43 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:54:43 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:54:43 user nova-compute[75734]:       <nova:owner>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:user uuid="5d077e3c6eb942f7a76262ac2d92b3b5">tempest-TaggedBootDevicesTest_v242-578229687-project-member</nova:user>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:project uuid="c0e20d284a3e4c61ac15f148ff7a776c">tempest-TaggedBootDevicesTest_v242-578229687</nova:project>
Nov 22 15:54:43 user nova-compute[75734]:       </nova:owner>
Nov 22 15:54:43 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:54:43 user nova-compute[75734]:       <nova:ports>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:port uuid="4b63078b-be6f-4742-bb3e-5faa6da21972">
Nov 22 15:54:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 15:54:43 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:port uuid="92b60767-112b-4298-8cbd-6d5e913f3a8e">
Nov 22 15:54:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 22 15:54:43 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:port uuid="0d9d9b26-7f67-44fb-8242-8cf0169030f5">
Nov 22 15:54:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Nov 22 15:54:43 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:port uuid="d4678086-e1b4-4e83-af50-21261b5c12cc">
Nov 22 15:54:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Nov 22 15:54:43 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:port uuid="b2c85b76-2687-490e-a4fb-60964d4d251a">
Nov 22 15:54:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Nov 22 15:54:43 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:port uuid="f44ead43-8018-4ae5-b91b-ab3a137d98e5">
Nov 22 15:54:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 22 15:54:43 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:43 user nova-compute[75734]:         <nova:port uuid="0eac44a6-a860-41bb-9b1f-31a419beeacb">
Nov 22 15:54:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 22 15:54:43 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:43 user nova-compute[75734]:       </nova:ports>
Nov 22 15:54:43 user nova-compute[75734]:     </nova:instance>
Nov 22 15:54:43 user nova-compute[75734]:   </metadata>
Nov 22 15:54:43 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:54:43 user nova-compute[75734]:     <system>
Nov 22 15:54:43 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:54:43 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:54:43 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:54:43 user nova-compute[75734]:       <entry name="serial">bacfbd1d-ad11-486f-bd13-08d72c346b73</entry>
Nov 22 15:54:43 user nova-compute[75734]:       <entry name="uuid">bacfbd1d-ad11-486f-bd13-08d72c346b73</entry>
Nov 22 15:54:43 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:54:43 user nova-compute[75734]:     </system>
Nov 22 15:54:43 user nova-compute[75734]:   </sysinfo>
Nov 22 15:54:43 user nova-compute[75734]:   <os>
Nov 22 15:54:43 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:54:43 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:54:43 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:54:43 user nova-compute[75734]:   </os>
Nov 22 15:54:43 user nova-compute[75734]:   <features>
Nov 22 15:54:43 user nova-compute[75734]:     <acpi/>
Nov 22 15:54:43 user nova-compute[75734]:     <apic/>
Nov 22 15:54:43 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:54:43 user nova-compute[75734]:   </features>
Nov 22 15:54:43 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:54:43 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:54:43 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:54:43 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:54:43 user nova-compute[75734]:   </clock>
Nov 22 15:54:43 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:54:43 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:54:43 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:54:43 user nova-compute[75734]:   </cpu>
Nov 22 15:54:43 user nova-compute[75734]:   <devices>
Nov 22 15:54:43 user nova-compute[75734]:     <disk type="file" device="cdrom">
Nov 22 15:54:43 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 15:54:43 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73/disk.config"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="hda" bus="ide"/>
Nov 22 15:54:43 user nova-compute[75734]:     </disk>
Nov 22 15:54:43 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:54:43 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:54:43 user nova-compute[75734]:       <source dev="/dev/sde"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <serial>dfdef766-3310-4f9d-8d37-07960c0abcb5</serial>
Nov 22 15:54:43 user nova-compute[75734]:     </disk>
Nov 22 15:54:43 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:54:43 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:54:43 user nova-compute[75734]:       <source dev="/dev/sdf"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <serial>3f398841-16c2-4578-822c-7ac9d8440f67</serial>
Nov 22 15:54:43 user nova-compute[75734]:     </disk>
Nov 22 15:54:43 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:54:43 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:54:43 user nova-compute[75734]:       <source dev="/dev/sdg"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="vdc" bus="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <serial>fb3e586d-ca8c-475f-8486-0fe169db2890</serial>
Nov 22 15:54:43 user nova-compute[75734]:     </disk>
Nov 22 15:54:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:43 user nova-compute[75734]:       <mac address="fa:16:3e:18:43:6b"/>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="tap4b63078b-be"/>
Nov 22 15:54:43 user nova-compute[75734]:     </interface>
Nov 22 15:54:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:43 user nova-compute[75734]:       <mac address="fa:16:3e:c0:36:ae"/>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="tap92b60767-11"/>
Nov 22 15:54:43 user nova-compute[75734]:     </interface>
Nov 22 15:54:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:43 user nova-compute[75734]:       <mac address="fa:16:3e:cd:f5:91"/>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="tap0d9d9b26-7f"/>
Nov 22 15:54:43 user nova-compute[75734]:     </interface>
Nov 22 15:54:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:43 user nova-compute[75734]:       <mac address="fa:16:3e:08:15:01"/>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="tapd4678086-e1"/>
Nov 22 15:54:43 user nova-compute[75734]:     </interface>
Nov 22 15:54:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:43 user nova-compute[75734]:       <mac address="fa:16:3e:b8:a5:75"/>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="tapb2c85b76-26"/>
Nov 22 15:54:43 user nova-compute[75734]:     </interface>
Nov 22 15:54:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:43 user nova-compute[75734]:       <mac address="fa:16:3e:e4:8c:4e"/>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="tapf44ead43-80"/>
Nov 22 15:54:43 user nova-compute[75734]:     </interface>
Nov 22 15:54:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:43 user nova-compute[75734]:       <mac address="fa:16:3e:04:52:36"/>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:43 user nova-compute[75734]:       <target dev="tap0eac44a6-a8"/>
Nov 22 15:54:43 user nova-compute[75734]:     </interface>
Nov 22 15:54:43 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:54:43 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73/console.log" append="off"/>
Nov 22 15:54:43 user nova-compute[75734]:     </serial>
Nov 22 15:54:43 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:54:43 user nova-compute[75734]:     <video>
Nov 22 15:54:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:43 user nova-compute[75734]:     </video>
Nov 22 15:54:43 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:54:43 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:54:43 user nova-compute[75734]:     </rng>
Nov 22 15:54:43 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:54:43 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:54:43 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:54:43 user nova-compute[75734]:     </memballoon>
Nov 22 15:54:43 user nova-compute[75734]:   </devices>
Nov 22 15:54:43 user nova-compute[75734]: </domain>
Nov 22 15:54:43 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=4b63078b-be6f-4742-bb3e-5faa6da21972,network=Network(bb6bc1e9-65ae-45cf-906f-27617ec8fb67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63078b-be') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=4b63078b-be6f-4742-bb3e-5faa6da21972,network=Network(bb6bc1e9-65ae-45cf-906f-27617ec8fb67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63078b-be') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ac8782a-3425-5452-9226-2d3b924cb672', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b63078b-be, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b63078b-be, col_values=(('qos', UUID('ba0c6504-82ab-4802-8c5b-cdb7617e8acd')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b63078b-be, col_values=(('external_ids', {'iface-id': '4b63078b-be6f-4742-bb3e-5faa6da21972', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:43:6b', 'vm-uuid': 'bacfbd1d-ad11-486f-bd13-08d72c346b73'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: INFO os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=4b63078b-be6f-4742-bb3e-5faa6da21972,network=Network(bb6bc1e9-65ae-45cf-906f-27617ec8fb67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63078b-be')
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=92b60767-112b-4298-8cbd-6d5e913f3a8e,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92b60767-11') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=92b60767-112b-4298-8cbd-6d5e913f3a8e,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92b60767-11') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:43 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance spawned successfully.
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c03fe945-a274-5c76-91cc-b878f1b3d61a', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92b60767-11, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92b60767-11, col_values=(('qos', UUID('de1a7d4e-209e-4549-a639-b761e05b7e33')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92b60767-11, col_values=(('external_ids', {'iface-id': '92b60767-112b-4298-8cbd-6d5e913f3a8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:36:ae', 'vm-uuid': 'bacfbd1d-ad11-486f-bd13-08d72c346b73'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: INFO os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=92b60767-112b-4298-8cbd-6d5e913f3a8e,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92b60767-11')
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=0d9d9b26-7f67-44fb-8242-8cf0169030f5,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0d9d9b26-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=0d9d9b26-7f67-44fb-8242-8cf0169030f5,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0d9d9b26-7f') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66e82018-bb56-56f4-9a29-6775a71fc43f', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d9d9b26-7f, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d9d9b26-7f, col_values=(('qos', UUID('c2461bd1-58d4-4ec3-b1fd-6ffc4542274f')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d9d9b26-7f, col_values=(('external_ids', {'iface-id': '0d9d9b26-7f67-44fb-8242-8cf0169030f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:f5:91', 'vm-uuid': 'bacfbd1d-ad11-486f-bd13-08d72c346b73'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: INFO os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=0d9d9b26-7f67-44fb-8242-8cf0169030f5,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0d9d9b26-7f')
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:15:01,bridge_name='br-int',has_traffic_filtering=True,id=d4678086-e1b4-4e83-af50-21261b5c12cc,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4678086-e1') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:15:01,bridge_name='br-int',has_traffic_filtering=True,id=d4678086-e1b4-4e83-af50-21261b5c12cc,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4678086-e1') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3293ee67-e475-5312-b00c-b072e5af1231', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: INFO nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Took 11.75 seconds to spawn the instance on the hypervisor.
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4678086-e1, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4678086-e1, col_values=(('qos', UUID('0aa62b7a-605c-4343-86b9-36a00c94961c')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4678086-e1, col_values=(('external_ids', {'iface-id': 'd4678086-e1b4-4e83-af50-21261b5c12cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:15:01', 'vm-uuid': 'bacfbd1d-ad11-486f-bd13-08d72c346b73'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: INFO os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:15:01,bridge_name='br-int',has_traffic_filtering=True,id=d4678086-e1b4-4e83-af50-21261b5c12cc,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4678086-e1')
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a5:75,bridge_name='br-int',has_traffic_filtering=True,id=b2c85b76-2687-490e-a4fb-60964d4d251a,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c85b76-26') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a5:75,bridge_name='br-int',has_traffic_filtering=True,id=b2c85b76-2687-490e-a4fb-60964d4d251a,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c85b76-26') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e11a99dd-5177-5818-a2f3-495d85c91874', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: INFO nova.compute.manager [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Rescuing
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2c85b76-26, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2c85b76-26, col_values=(('qos', UUID('5b8ec5d9-ce60-414a-ba4a-753923bb72fc')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2c85b76-26, col_values=(('external_ids', {'iface-id': 'b2c85b76-2687-490e-a4fb-60964d4d251a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:a5:75', 'vm-uuid': 'bacfbd1d-ad11-486f-bd13-08d72c346b73'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: INFO nova.compute.manager [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Took 43.16 seconds to build instance.
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: INFO os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a5:75,bridge_name='br-int',has_traffic_filtering=True,id=b2c85b76-2687-490e-a4fb-60964d4d251a,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c85b76-26')
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:4e,bridge_name='br-int',has_traffic_filtering=True,id=f44ead43-8018-4ae5-b91b-ab3a137d98e5,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf44ead43-80') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:4e,bridge_name='br-int',has_traffic_filtering=True,id=f44ead43-8018-4ae5-b91b-ab3a137d98e5,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf44ead43-80') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0e5673ce-153f-4404-bffa-b32b20ccbac0 tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.318s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f088e3e-0a25-5550-9a13-9e5226c227b8', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf44ead43-80, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf44ead43-80, col_values=(('qos', UUID('87e8195a-18f0-4998-8f29-54fa732731d1')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf44ead43-80, col_values=(('external_ids', {'iface-id': 'f44ead43-8018-4ae5-b91b-ab3a137d98e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:8c:4e', 'vm-uuid': 'bacfbd1d-ad11-486f-bd13-08d72c346b73'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: INFO os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:4e,bridge_name='br-int',has_traffic_filtering=True,id=f44ead43-8018-4ae5-b91b-ab3a137d98e5,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf44ead43-80')
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:52:36,bridge_name='br-int',has_traffic_filtering=True,id=0eac44a6-a860-41bb-9b1f-31a419beeacb,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac44a6-a8') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:52:36,bridge_name='br-int',has_traffic_filtering=True,id=0eac44a6-a860-41bb-9b1f-31a419beeacb,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac44a6-a8') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2381c669-190d-5cf3-bd55-de3037d727b8', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0eac44a6-a8, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0eac44a6-a8, col_values=(('qos', UUID('152e20c6-ddbd-4a65-a10f-7c57c58a2ce0')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0eac44a6-a8, col_values=(('external_ids', {'iface-id': '0eac44a6-a860-41bb-9b1f-31a419beeacb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:52:36', 'vm-uuid': 'bacfbd1d-ad11-486f-bd13-08d72c346b73'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:44 user nova-compute[75734]: INFO os_vif [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:52:36,bridge_name='br-int',has_traffic_filtering=True,id=0eac44a6-a860-41bb-9b1f-31a419beeacb,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac44a6-a8')
Nov 22 15:54:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] No BDM found with device name hda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] No VIF found with MAC fa:16:3e:18:43:6b, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] No VIF found with MAC fa:16:3e:b8:a5:75, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:54:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Using config drive
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG nova.network.neutron [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updating instance_info_cache with network_info: [{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Creating config drive at /opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73/disk.config
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsko5htj9 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsko5htj9" returned: 0 in 0.052s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-3622fa4b-7168-48e3-b579-fecd284db769 req-2fe87c36-05f2-4169-9a1e-2f4bab41b18f service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-unplugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3622fa4b-7168-48e3-b579-fecd284db769 req-2fe87c36-05f2-4169-9a1e-2f4bab41b18f service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3622fa4b-7168-48e3-b579-fecd284db769 req-2fe87c36-05f2-4169-9a1e-2f4bab41b18f service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3622fa4b-7168-48e3-b579-fecd284db769 req-2fe87c36-05f2-4169-9a1e-2f4bab41b18f service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-3622fa4b-7168-48e3-b579-fecd284db769 req-2fe87c36-05f2-4169-9a1e-2f4bab41b18f service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-unplugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-3622fa4b-7168-48e3-b579-fecd284db769 req-2fe87c36-05f2-4169-9a1e-2f4bab41b18f service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received unexpected event network-vif-unplugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with vm_state active and task_state rescuing.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-1c756d64-dd99-402f-994b-a080a3fc483b req-396b3445-53de-4ec2-9da0-e19c29bce76b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1c756d64-dd99-402f-994b-a080a3fc483b req-396b3445-53de-4ec2-9da0-e19c29bce76b service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1c756d64-dd99-402f-994b-a080a3fc483b req-396b3445-53de-4ec2-9da0-e19c29bce76b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1c756d64-dd99-402f-994b-a080a3fc483b req-396b3445-53de-4ec2-9da0-e19c29bce76b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-1c756d64-dd99-402f-994b-a080a3fc483b req-396b3445-53de-4ec2-9da0-e19c29bce76b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-1c756d64-dd99-402f-994b-a080a3fc483b req-396b3445-53de-4ec2-9da0-e19c29bce76b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received unexpected event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with vm_state active and task_state rescuing.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-706e32b1-4e2b-415b-a66a-bb1d77225c6d req-6742b3b0-e741-41bc-bafb-0702f97c30fa service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-b0832b17-1ef0-4883-9296-2114583eef82 req-898eb11b-0465-4163-944d-4e50e94a9302 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b0832b17-1ef0-4883-9296-2114583eef82 req-898eb11b-0465-4163-944d-4e50e94a9302 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b0832b17-1ef0-4883-9296-2114583eef82 req-898eb11b-0465-4163-944d-4e50e94a9302 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b0832b17-1ef0-4883-9296-2114583eef82 req-898eb11b-0465-4163-944d-4e50e94a9302 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-b0832b17-1ef0-4883-9296-2114583eef82 req-898eb11b-0465-4163-944d-4e50e94a9302 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-b0832b17-1ef0-4883-9296-2114583eef82 req-898eb11b-0465-4163-944d-4e50e94a9302 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-2e02f6f1-17f1-490b-ac1d-7dcf0e3f493b req-a8ebe035-4db6-455c-a1da-511a82d3b43b service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.compute.manager [req-09bea03f-22f0-4926-b9de-e6f780a8fd48 req-17108948-3d0d-434d-ba77-0c696d045448 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 for instance with vm_state building and task_state spawning.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance destroyed successfully.
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance spawned successfully.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7430MB free_disk=25.466033935546875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Attempting rescue
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75734) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Creating image(s)
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'trusted_certs' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Took 14.28 seconds to spawn the instance on the hypervisor.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c158823f-476c-4691-9191-affa6e302565 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance bacfbd1d-ad11-486f-bd13-08d72c346b73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e542b93-4c34-4101-ab33-f4dcf81ae00f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.compute.manager [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] instance snapshotting
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.compute.manager [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Took 54.80 seconds to build instance.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.224s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6d3c525d-5eaf-429d-a28c-2f1919610e46 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.967s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue" returned: 0 in 0.068s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'migration_context' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Beginning live snapshot process
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.base [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<c9ec4e5a-a31e-470e-9d8b-db2ac4fef115> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Start _get_guest_xml network_info=[{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:fc:ba:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'resources' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.base [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<c9ec4e5a-a31e-470e-9d8b-db2ac4fef115> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'numa_topology' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.base [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<c9ec4e5a-a31e-470e-9d8b-db2ac4fef115> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:51 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:54:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.objects.base [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<c9ec4e5a-a31e-470e-9d8b-db2ac4fef115> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1560752947',display_name='tempest-ServerRescueNegativeTestJSON-server-1560752947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1560752947',id=2,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-cfwznl3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:14Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=c9ec4e5a-a31e-470e-9d8b-db2ac4fef115,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:fc:ba:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:fc:ba:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.objects.instance [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'pci_devices' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.objects.base [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<c9ec4e5a-a31e-470e-9d8b-db2ac4fef115> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:54:52 user nova-compute[75734]:   <uuid>c9ec4e5a-a31e-470e-9d8b-db2ac4fef115</uuid>
Nov 22 15:54:52 user nova-compute[75734]:   <name>instance-00000002</name>
Nov 22 15:54:52 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:54:52 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:54:52 user nova-compute[75734]:   <metadata>
Nov 22 15:54:52 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:54:52 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:54:52 user nova-compute[75734]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1560752947</nova:name>
Nov 22 15:54:52 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:54:51</nova:creationTime>
Nov 22 15:54:52 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:54:52 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:54:52 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:54:52 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:54:52 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:54:52 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:54:52 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:54:52 user nova-compute[75734]:       <nova:owner>
Nov 22 15:54:52 user nova-compute[75734]:         <nova:user uuid="ea603e7c80014f17a76fec19b54443c9">tempest-ServerRescueNegativeTestJSON-970419785-project-member</nova:user>
Nov 22 15:54:52 user nova-compute[75734]:         <nova:project uuid="963ad36880484ed59f2b34c64a6e450e">tempest-ServerRescueNegativeTestJSON-970419785</nova:project>
Nov 22 15:54:52 user nova-compute[75734]:       </nova:owner>
Nov 22 15:54:52 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:54:52 user nova-compute[75734]:       <nova:ports>
Nov 22 15:54:52 user nova-compute[75734]:         <nova:port uuid="c3cf56e1-e41c-4bfc-919e-e25bc713c512">
Nov 22 15:54:52 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 15:54:52 user nova-compute[75734]:         </nova:port>
Nov 22 15:54:52 user nova-compute[75734]:       </nova:ports>
Nov 22 15:54:52 user nova-compute[75734]:     </nova:instance>
Nov 22 15:54:52 user nova-compute[75734]:   </metadata>
Nov 22 15:54:52 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:54:52 user nova-compute[75734]:     <system>
Nov 22 15:54:52 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:54:52 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:54:52 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:54:52 user nova-compute[75734]:       <entry name="serial">c9ec4e5a-a31e-470e-9d8b-db2ac4fef115</entry>
Nov 22 15:54:52 user nova-compute[75734]:       <entry name="uuid">c9ec4e5a-a31e-470e-9d8b-db2ac4fef115</entry>
Nov 22 15:54:52 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:54:52 user nova-compute[75734]:     </system>
Nov 22 15:54:52 user nova-compute[75734]:   </sysinfo>
Nov 22 15:54:52 user nova-compute[75734]:   <os>
Nov 22 15:54:52 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:54:52 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:54:52 user nova-compute[75734]:   </os>
Nov 22 15:54:52 user nova-compute[75734]:   <features>
Nov 22 15:54:52 user nova-compute[75734]:     <acpi/>
Nov 22 15:54:52 user nova-compute[75734]:     <apic/>
Nov 22 15:54:52 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:54:52 user nova-compute[75734]:   </features>
Nov 22 15:54:52 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:54:52 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:54:52 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:54:52 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:54:52 user nova-compute[75734]:   </clock>
Nov 22 15:54:52 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:54:52 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:54:52 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:54:52 user nova-compute[75734]:   </cpu>
Nov 22 15:54:52 user nova-compute[75734]:   <devices>
Nov 22 15:54:52 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:54:52 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:54:52 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue"/>
Nov 22 15:54:52 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:54:52 user nova-compute[75734]:     </disk>
Nov 22 15:54:52 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:54:52 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:54:52 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk"/>
Nov 22 15:54:52 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 15:54:52 user nova-compute[75734]:     </disk>
Nov 22 15:54:52 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:54:52 user nova-compute[75734]:       <mac address="fa:16:3e:fc:ba:b4"/>
Nov 22 15:54:52 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:52 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:54:52 user nova-compute[75734]:       <target dev="tapc3cf56e1-e4"/>
Nov 22 15:54:52 user nova-compute[75734]:     </interface>
Nov 22 15:54:52 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:54:52 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/console.log" append="off"/>
Nov 22 15:54:52 user nova-compute[75734]:     </serial>
Nov 22 15:54:52 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:54:52 user nova-compute[75734]:     <video>
Nov 22 15:54:52 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:54:52 user nova-compute[75734]:     </video>
Nov 22 15:54:52 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:54:52 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:54:52 user nova-compute[75734]:     </rng>
Nov 22 15:54:52 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:54:52 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:54:52 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:54:52 user nova-compute[75734]:     </memballoon>
Nov 22 15:54:52 user nova-compute[75734]:   </devices>
Nov 22 15:54:52 user nova-compute[75734]: </domain>
Nov 22 15:54:52 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:54:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance destroyed successfully.
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No VIF found with MAC fa:16:3e:fc:ba:b4, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.300s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json -f qcow2" returned: 0 in 0.408s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplfttm6hh/e258140a0e6d4eb88259438ddf2b2d58.delta 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplfttm6hh/e258140a0e6d4eb88259438ddf2b2d58.delta 1073741824" returned: 0 in 0.054s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:53 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 15:54:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75734) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 22 15:54:53 user nova-compute[75734]: INFO nova.virt.libvirt.host [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] UEFI support detected
Nov 22 15:54:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] COPY block job progress, current cursor: 47579136 final cursor: 75497472 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-3364d768-e07a-468a-bf8a-68fb8ff1cb7e req-61cce87f-7ef1-4ca1-abe6-9dba72ce9866 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3364d768-e07a-468a-bf8a-68fb8ff1cb7e req-61cce87f-7ef1-4ca1-abe6-9dba72ce9866 service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3364d768-e07a-468a-bf8a-68fb8ff1cb7e req-61cce87f-7ef1-4ca1-abe6-9dba72ce9866 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3364d768-e07a-468a-bf8a-68fb8ff1cb7e req-61cce87f-7ef1-4ca1-abe6-9dba72ce9866 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-3364d768-e07a-468a-bf8a-68fb8ff1cb7e req-61cce87f-7ef1-4ca1-abe6-9dba72ce9866 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:55 user nova-compute[75734]: WARNING nova.compute.manager [req-3364d768-e07a-468a-bf8a-68fb8ff1cb7e req-61cce87f-7ef1-4ca1-abe6-9dba72ce9866 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received unexpected event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with vm_state active and task_state rescuing.
Nov 22 15:54:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:54:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 15:54:55 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplfttm6hh/e258140a0e6d4eb88259438ddf2b2d58.delta /opt/stack/data/nova/instances/snapshots/tmplfttm6hh/e258140a0e6d4eb88259438ddf2b2d58 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updating instance_info_cache with network_info: [{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:54:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplfttm6hh/e258140a0e6d4eb88259438ddf2b2d58.delta /opt/stack/data/nova/instances/snapshots/tmplfttm6hh/e258140a0e6d4eb88259438ddf2b2d58" returned: 0 in 0.501s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:54:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Snapshot extracted, beginning image upload
Nov 22 15:54:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:54:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d4c6716-b3bb-4056-a532-cd2e902b542d req-ee4fa759-5be6-47c3-a0f6-e9e6100a8427 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d4c6716-b3bb-4056-a532-cd2e902b542d req-ee4fa759-5be6-47c3-a0f6-e9e6100a8427 service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:54:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d4c6716-b3bb-4056-a532-cd2e902b542d req-ee4fa759-5be6-47c3-a0f6-e9e6100a8427 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:54:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d4c6716-b3bb-4056-a532-cd2e902b542d req-ee4fa759-5be6-47c3-a0f6-e9e6100a8427 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:54:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d4c6716-b3bb-4056-a532-cd2e902b542d req-ee4fa759-5be6-47c3-a0f6-e9e6100a8427 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:54:57 user nova-compute[75734]: WARNING nova.compute.manager [req-8d4c6716-b3bb-4056-a532-cd2e902b542d req-ee4fa759-5be6-47c3-a0f6-e9e6100a8427 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received unexpected event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with vm_state active and task_state rescuing.
Nov 22 15:54:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-be63ce11-deab-420f-8ee9-3519f3d41b7a tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:54:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-changed-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:54:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Refreshing instance network info cache due to event network-changed-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:54:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] Acquiring lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:54:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] Acquired lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:54:58 user nova-compute[75734]: DEBUG nova.network.neutron [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Refreshing network info cache for port aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:54:59 user nova-compute[75734]: DEBUG nova.network.neutron [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updated VIF entry in instance network info cache for port aa49cc3d-3e41-4da9-ba4a-ed765f2eb485. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:54:59 user nova-compute[75734]: DEBUG nova.network.neutron [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updating instance_info_cache with network_info: [{"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:54:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dae1624e-06d2-4b2c-b118-56f7a1ddeb32 req-3f66916b-a3a0-43f9-ab99-aead338cc83e service nova] Releasing lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Snapshot image upload complete
Nov 22 15:55:00 user nova-compute[75734]: INFO nova.compute.manager [None req-7c6bfad3-f8ed-4361-b529-bbd65ec7af78 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Took 8.24 seconds to snapshot the instance on the hypervisor.
Nov 22 15:55:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lazy-loading 'flavor' on Instance uuid 02833b01-4e0b-404a-8aae-d47fa0ac6794 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:01 user nova-compute[75734]: INFO nova.compute.manager [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Attaching volume a8214f74-e2e0-4be6-b204-9ed5995b7ee4 to /dev/vdb
Nov 22 15:55:01 user nova-compute[75734]: DEBUG os_brick.utils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fafd53f-8c11-43a4-8cdd-f136aae86aa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c05a95-1a47-4092-b6f0-a6e8c93e0a3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c08249-7009-4e64-a07d-37dd82191b12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c143052d-9cea-4523-8843-bf6d68e848a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:02 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:55:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1332b5-8ea3-4a30-b87d-5f81359f9074]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG os_brick.utils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:02 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updating existing volume attachment record: c004284e-8f13-44f1-9e88-e66a5b4dcd8f {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:55:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-changed-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Refreshing instance network info cache due to event network-changed-e408954b-2896-43b1-a721-32a773a0008c. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] Acquiring lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] Acquired lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Refreshing network info cache for port e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG nova.objects.instance [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lazy-loading 'flavor' on Instance uuid a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Updated VIF entry in instance network info cache for port e408954b-2896-43b1-a721-32a773a0008c. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Updating instance_info_cache with network_info: [{"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d575b456-2188-467c-8e1c-a0655355401d req-828ab97a-3df8-4250-a1c0-25a27356b83c service nova] Releasing lock "refresh_cache-a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:08 user nova-compute[75734]: INFO nova.compute.manager [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Attaching volume 609d12e6-0cdd-43b1-8917-f28605476935 to /dev/vdb
Nov 22 15:55:08 user nova-compute[75734]: DEBUG os_brick.utils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[032e97a0-9f9e-4aaf-9490-4c065f347eec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62947d6-88ed-4fda-9e40-2cfebfe63825]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fb9015-beb0-4736-9cce-ec6ff6c993a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904999a-ffc5-41fb-a6f9-c5bbaec48c29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:08 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:55:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca7f780-0764-49f9-a5d6-46cdc35468a5]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG os_brick.utils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:08 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Updating existing volume attachment record: 2cb0e351-b1fe-4bc7-944a-12df6ae2773a {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcflgNOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:09 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:09 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:09 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c438d7-ec3b-4008-b71a-c0d624b90d23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:55:09 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad1042a-2695-4e2b-8048-adca6aac60b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4] added
Nov 22 15:55:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5588d0-f873-4f41-af27-7d1dfcb93cbd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-changed-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Refreshing instance network info cache due to event network-changed-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] Acquiring lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] Acquired lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:55:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Refreshing network info cache for port 22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a4c76c-7e07-4d14-9e88-9125bed871fb]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcflgNOY {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcflgNOY" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae571c92-4436-43f3-9bd3-44f592bb3efd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TcflgNOY'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea54bd15-fddc-4f27-9954-6968478a2351]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c06939-1a02-4dff-a6bf-9cd758137895]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:10 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG nova.network.neutron [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Updated VIF entry in instance network info cache for port 22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG nova.network.neutron [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f7a6f8ac-b755-4a13-a181-1a0fe2423011 req-a928dc84-cf98-46b1-84a8-c86c24bd227a service nova] Releasing lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "interface-c158823f-476c-4691-9191-affa6e302565-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "interface-c158823f-476c-4691-9191-affa6e302565-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:10 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'flavor' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'pci_requests' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG nova.objects.base [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Object Instance<c158823f-476c-4691-9191-affa6e302565> lazy-loaded attributes: flavor,pci_requests {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG nova.policy [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ae04e9a5bfa4c4088140b509e449832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08ca1d63bf409ba53a06635e0fdb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --login" returned: 0 in 1.108s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc35ec-45bd-40a9-a3bb-0f15f116d962]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260]
Nov 22 15:55:11 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:11 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e7a30-1b02-43c0-8681-d4a81a091b4e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[993ac8ff-2f45-4d76-a2d8-f727948163d6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:11 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.413s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e55ae25-15cb-4c82-8393-69d27728196f]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcflgNOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:55:11 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Successfully created port: cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.450s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] <== connect_volume: return (2453ms) {'type': 'block', 'scsi_wwn': '26531613239386337', 'path': '/dev/sdh'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531613239386337', 'path': '/dev/sdh'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lazy-loading 'flavor' on Instance uuid 02833b01-4e0b-404a-8aae-d47fa0ac6794 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Successfully updated port: cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:55:12 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:12 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:55:12 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:12 user nova-compute[75734]:   <serial>a8214f74-e2e0-4be6-b204-9ed5995b7ee4</serial>
Nov 22 15:55:12 user nova-compute[75734]: </disk>
Nov 22 15:55:12 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquired lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-changed-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Refreshing instance network info cache due to event network-changed-cc127665-2c38-4d00-b78d-2e3d0634bc56. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] Acquiring lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] No VIF found with MAC fa:16:3e:2b:1c:be, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2290541c-c2e1-4536-ab21-3dcb2d5d6953 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.142s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Releasing lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] Acquired lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Refreshing network info cache for port cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converting VIF {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG os_vif [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf1c8391-5754-531b-959b-bc24a5eb3e0e', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc127665-2c, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc127665-2c, col_values=(('qos', UUID('bd258b1e-b840-464f-a043-2450b80f0d29')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc127665-2c, col_values=(('external_ids', {'iface-id': 'cc127665-2c38-4d00-b78d-2e3d0634bc56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:e4:79', 'vm-uuid': 'c158823f-476c-4691-9191-affa6e302565'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: INFO os_vif [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c')
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converting VIF {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] attach device xml: <interface type="ethernet">
Nov 22 15:55:13 user nova-compute[75734]:   <mac address="fa:16:3e:0d:e4:79"/>
Nov 22 15:55:13 user nova-compute[75734]:   <model type="virtio"/>
Nov 22 15:55:13 user nova-compute[75734]:   <mtu size="1442"/>
Nov 22 15:55:13 user nova-compute[75734]:   <target dev="tapcc127665-2c"/>
Nov 22 15:55:13 user nova-compute[75734]: </interface>
Nov 22 15:55:13 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-e21eaac5-e8e2-481e-a47e-c3fcd0e15264 req-e5b75e51-6e4c-4531-adb2-0f0b9c2228ca service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e21eaac5-e8e2-481e-a47e-c3fcd0e15264 req-e5b75e51-6e4c-4531-adb2-0f0b9c2228ca service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e21eaac5-e8e2-481e-a47e-c3fcd0e15264 req-e5b75e51-6e4c-4531-adb2-0f0b9c2228ca service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e21eaac5-e8e2-481e-a47e-c3fcd0e15264 req-e5b75e51-6e4c-4531-adb2-0f0b9c2228ca service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-e21eaac5-e8e2-481e-a47e-c3fcd0e15264 req-e5b75e51-6e4c-4531-adb2-0f0b9c2228ca service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:13 user nova-compute[75734]: WARNING nova.compute.manager [req-e21eaac5-e8e2-481e-a47e-c3fcd0e15264 req-e5b75e51-6e4c-4531-adb2-0f0b9c2228ca service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received unexpected event network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 for instance with vm_state active and task_state None.
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Updated VIF entry in instance network info cache for port cc127665-2c38-4d00-b78d-2e3d0634bc56. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e0d033c-ea12-48ec-bba3-f1d882fc8519 req-625407cb-1fc0-4e6f-8b61-2b0597f9316c service nova] Releasing lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No BDM found with device name hda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No VIF found with MAC fa:16:3e:0f:10:66, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:55:13 user nova-compute[75734]:   <nova:package version="0.0.0"/>
Nov 22 15:55:13 user nova-compute[75734]:   <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:55:13 user nova-compute[75734]:   <nova:creationTime>2023-11-22 15:55:13</nova:creationTime>
Nov 22 15:55:13 user nova-compute[75734]:   <nova:flavor name="m1.tiny">
Nov 22 15:55:13 user nova-compute[75734]:     <nova:memory>512</nova:memory>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:disk>1</nova:disk>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:swap>0</nova:swap>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:vcpus>1</nova:vcpus>
Nov 22 15:55:13 user nova-compute[75734]:   </nova:flavor>
Nov 22 15:55:13 user nova-compute[75734]:   <nova:owner>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:55:13 user nova-compute[75734]:   </nova:owner>
Nov 22 15:55:13 user nova-compute[75734]:   <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:55:13 user nova-compute[75734]:   <nova:ports>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:55:13 user nova-compute[75734]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:55:13 user nova-compute[75734]:     </nova:port>
Nov 22 15:55:13 user nova-compute[75734]:     <nova:port uuid="cc127665-2c38-4d00-b78d-2e3d0634bc56">
Nov 22 15:55:13 user nova-compute[75734]:       <nova:ip type="fixed" address="10.10.10.164" ipVersion="4"/>
Nov 22 15:55:13 user nova-compute[75734]:     </nova:port>
Nov 22 15:55:13 user nova-compute[75734]:   </nova:ports>
Nov 22 15:55:13 user nova-compute[75734]: </nova:instance>
Nov 22 15:55:13 user nova-compute[75734]:  {{(pid=75734) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2b328d5c-5a4b-4685-8381-8e1f7dec271e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "interface-c158823f-476c-4691-9191-affa6e302565-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.011s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "c158823f-476c-4691-9191-affa6e302565" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:13 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'flavor' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "c158823f-476c-4691-9191-affa6e302565" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:14 user nova-compute[75734]: INFO nova.compute.manager [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Attaching volume bcfd34da-7597-4568-b2f9-8dc058a78cab to /dev/vdb
Nov 22 15:55:14 user nova-compute[75734]: DEBUG os_brick.utils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e2c4d-6690-4efd-8777-38c09ed8f5ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7d9c19-9600-49a3-a44c-433f5ab07828]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[35950e62-0e16-4b45-9ab4-96bb262aec0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86356f6-6218-43be-bf41-d8a07de5dbb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:14 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:55:14 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbac171-9600-47ef-b18d-b4c8665427d2]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG os_brick.utils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:14 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Updating existing volume attachment record: fc3bcc96-79a3-4a86-a726-21108dc694a3 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:15 user nova-compute[75734]: DEBUG nova.compute.manager [req-cf561230-5043-4cbe-880e-bb2ea60f4286 req-2683b4ac-6c3f-44e2-b5d4-0d8ce1cbe08c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cf561230-5043-4cbe-880e-bb2ea60f4286 req-2683b4ac-6c3f-44e2-b5d4-0d8ce1cbe08c service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cf561230-5043-4cbe-880e-bb2ea60f4286 req-2683b4ac-6c3f-44e2-b5d4-0d8ce1cbe08c service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cf561230-5043-4cbe-880e-bb2ea60f4286 req-2683b4ac-6c3f-44e2-b5d4-0d8ce1cbe08c service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:15 user nova-compute[75734]: DEBUG nova.compute.manager [req-cf561230-5043-4cbe-880e-bb2ea60f4286 req-2683b4ac-6c3f-44e2-b5d4-0d8ce1cbe08c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:15 user nova-compute[75734]: WARNING nova.compute.manager [req-cf561230-5043-4cbe-880e-bb2ea60f4286 req-2683b4ac-6c3f-44e2-b5d4-0d8ce1cbe08c service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received unexpected event network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 for instance with vm_state active and task_state None.
Nov 22 15:55:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:15 user nova-compute[75734]: INFO nova.compute.manager [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Detaching volume a8214f74-e2e0-4be6-b204-9ed5995b7ee4
Nov 22 15:55:16 user nova-compute[75734]: INFO nova.virt.block_device [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Attempting to driver detach volume a8214f74-e2e0-4be6-b204-9ed5995b7ee4 from mountpoint /dev/vdb
Nov 22 15:55:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Attempting to detach device vdb from instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:55:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:55:16 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:16 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:55:16 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:16 user nova-compute[75734]:   <serial>a8214f74-e2e0-4be6-b204-9ed5995b7ee4</serial>
Nov 22 15:55:16 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:55:16 user nova-compute[75734]: </disk>
Nov 22 15:55:16 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:16 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Successfully detached device vdb from instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 from the persistent domain config.
Nov 22 15:55:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:55:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:55:16 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:16 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:55:16 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:16 user nova-compute[75734]:   <serial>a8214f74-e2e0-4be6-b204-9ed5995b7ee4</serial>
Nov 22 15:55:16 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:55:16 user nova-compute[75734]: </disk>
Nov 22 15:55:16 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:55:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:24 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:24 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:24 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c89e915-fc79-4c60-b491-f1dbaedd0b47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:55:24 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e7372-9785-49c1-b282-485628099f32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935] added
Nov 22 15:55:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[70728b4f-2626-4046-b411-c9a2e6369d45]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNgJsZEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:24 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec700cf0-35ec-4415-abee-d0fcf81d903f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvVaiukp {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvVaiukp" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1b1603-a414-48e1-bc0f-5edb334fdcfe]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zvVaiukp'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1885a6-0d35-4f4b-b08e-2f6d4395da8b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856bd92-afaf-42e7-a2f7-b07929a42ae9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-changed-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Refreshing instance network info cache due to event network-changed-c18f633a-a6fa-40d8-b7af-38fc71569f7e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] Acquiring lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] Acquired lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Refreshing network info cache for port c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.objects.instance [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lazy-loading 'flavor' on Instance uuid a0dfd979-e5f5-4ca0-b864-90c12641cfe9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:24 user nova-compute[75734]: INFO nova.compute.manager [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Attaching volume 16b69e13-36eb-4db1-ae8c-5b2fbaa04edc to /dev/vdb
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updated VIF entry in instance network info cache for port c18f633a-a6fa-40d8-b7af-38fc71569f7e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updating instance_info_cache with network_info: [{"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-73c9a3aa-f5ce-4a4d-893b-103750799bb2 req-c8b956fe-3f56-4b29-a605-2e1efdf8d811 service nova] Releasing lock "refresh_cache-a0dfd979-e5f5-4ca0-b864-90c12641cfe9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG os_brick.utils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[12da323e-5b42-43c4-b7aa-ae0e51abceab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2fa3b-2b6f-4a66-93f4-cd6051a330ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bc4019-d389-4489-9f83-256323cabb1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b087e4a-d08f-43d0-987e-312b41c8cd13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:25 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0c35c2-e38f-49b5-977f-f11e0052c3ad]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.utils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updating existing volume attachment record: f3c9dfdb-14be-4f22-80b6-d90102de58eb {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --login" returned: 0 in 1.090s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa5a9fc-80eb-46a1-bb15-912c1e27cdbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]
Nov 22 15:55:25 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:25 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf63a74-5048-499f-9f29-cf97e6012ce3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb04a6a-e5c0-4567-86b3-84e58bfa7b77]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:25 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.362s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55632cb-3e62-4f7c-88fe-611f62803d2c]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:55:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.411s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] <== connect_volume: return (2413ms) {'type': 'block', 'scsi_wwn': '23036616336313638', 'path': '/dev/sdi'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036616336313638', 'path': '/dev/sdi'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.300s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:26 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:26 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG nova.objects.instance [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lazy-loading 'flavor' on Instance uuid a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d405e-bad9-4ded-8778-fdf9f42c0aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:55:26 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03daa3d-54be-429a-a1c5-b22d7025c96a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab] added
Nov 22 15:55:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[be881bbd-430b-49cb-ba5c-e79dc439ac99]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:55:26 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:26 user nova-compute[75734]:   <source dev="/dev/sdi"/>
Nov 22 15:55:26 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:26 user nova-compute[75734]:   <serial>609d12e6-0cdd-43b1-8917-f28605476935</serial>
Nov 22 15:55:26 user nova-compute[75734]: </disk>
Nov 22 15:55:26 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f71b686-d33c-4bb8-99ef-dcf40127d820]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GNgJsZEI {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GNgJsZEI" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[97891a53-22dd-414b-9bd9-c8370139e036]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GNgJsZEI'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8e4199-ac7a-4596-8255-b5b4b2fa397b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780f2ee-b155-4a4d-8313-93c51850e02f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74c827-e584-4217-8ef9-8a773d0b8a51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260]
Nov 22 15:55:26 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f154a562-b0bb-405c-9cc8-7d2e2fcc536c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d3a65-7667-4362-b283-9614a7e4b920]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b864d21-f16b-439e-a956-b494067f6393]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] No VIF found with MAC fa:16:3e:07:e1:53, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47d7cb2c-49da-498e-8a3c-2095a53b6cd2 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.687s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.utils [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0eb960-e819-45e8-be89-af5828e44105]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed5e150-9005-4485-b688-0550088e19e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165fd48-857d-4024-adac-98b1bb088db5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95f44e-465a-4fe2-8429-ebb92a57c88a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:27 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:55:27 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b073eb03-b671-4b06-adca-b28bba593825]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.utils [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNgJsZEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] <== connect_volume: return (3705ms) {'type': 'block', 'scsi_wwn': '23635306338326538', 'path': '/dev/sdj'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635306338326538', 'path': '/dev/sdj'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'flavor' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:55:27 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:27 user nova-compute[75734]:   <source dev="/dev/sdj"/>
Nov 22 15:55:27 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:27 user nova-compute[75734]:   <serial>bcfd34da-7597-4568-b2f9-8dc058a78cab</serial>
Nov 22 15:55:27 user nova-compute[75734]: </disk>
Nov 22 15:55:27 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:55:28 user nova-compute[75734]: INFO nova.compute.manager [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Swapping volume 609d12e6-0cdd-43b1-8917-f28605476935 for 8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No BDM found with device name hda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] No VIF found with MAC fa:16:3e:0f:10:66, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:55:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a66ba931-1d5d-4077-bb85-600c1e7c1145 tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.442s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "c158823f-476c-4691-9191-affa6e302565" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:29 user nova-compute[75734]: INFO nova.compute.manager [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Detaching volume bcfd34da-7597-4568-b2f9-8dc058a78cab
Nov 22 15:55:29 user nova-compute[75734]: INFO nova.virt.block_device [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Attempting to driver detach volume bcfd34da-7597-4568-b2f9-8dc058a78cab from mountpoint /dev/vdb
Nov 22 15:55:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Attempting to detach device vdb from instance c158823f-476c-4691-9191-affa6e302565 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:55:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:55:29 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:29 user nova-compute[75734]:   <source dev="/dev/sdj"/>
Nov 22 15:55:29 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:29 user nova-compute[75734]:   <serial>bcfd34da-7597-4568-b2f9-8dc058a78cab</serial>
Nov 22 15:55:29 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 15:55:29 user nova-compute[75734]: </disk>
Nov 22 15:55:29 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully detached device vdb from instance c158823f-476c-4691-9191-affa6e302565 from the persistent domain config.
Nov 22 15:55:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c158823f-476c-4691-9191-affa6e302565 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:55:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:55:29 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:29 user nova-compute[75734]:   <source dev="/dev/sdj"/>
Nov 22 15:55:29 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:29 user nova-compute[75734]:   <serial>bcfd34da-7597-4568-b2f9-8dc058a78cab</serial>
Nov 22 15:55:29 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 15:55:29 user nova-compute[75734]: </disk>
Nov 22 15:55:29 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:55:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghocpLMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:32 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:32 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:32 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[44071d79-0d7e-4abb-9d01-b6eb57df5e6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:55:32 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[090276cd-fad1-4001-8a0d-7193a07ae77f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc] added
Nov 22 15:55:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db5ec0-8564-435a-838a-deb3d45f1752]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8e2c26-f654-4dd5-88ff-1f4da85b1b1a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghocpLMX {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghocpLMX" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd40113-cd38-4320-ba63-040f69e6f062]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ghocpLMX'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48359a-3309-4903-a03e-7b6f0d32d221]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc6bc2-eb66-481a-98d4-253c11784cce]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5168da30-9f3c-4c82-a3e4-cee5b476ce52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260]
Nov 22 15:55:32 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc4b81b-eda1-4aff-858d-bd35330ce930]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff5d062-c2bc-454e-b5f2-94ddf0285463]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b771aa32-1c7e-49ed-a650-e2cb26b9cdd8]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:55:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghocpLMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:55:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26364303665383332', 'path': '/dev/sdk'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364303665383332', 'path': '/dev/sdk'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:55:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lazy-loading 'flavor' on Instance uuid a0dfd979-e5f5-4ca0-b864-90c12641cfe9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] attach device xml: <disk type="block" device="disk">
Nov 22 15:55:33 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:33 user nova-compute[75734]:   <source dev="/dev/sdk"/>
Nov 22 15:55:33 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:33 user nova-compute[75734]:   <serial>16b69e13-36eb-4db1-ae8c-5b2fbaa04edc</serial>
Nov 22 15:55:33 user nova-compute[75734]: </disk>
Nov 22 15:55:33 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:55:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:55:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] No VIF found with MAC fa:16:3e:3d:70:99, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:55:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd75c8ab-2275-426a-843b-3a0bfc5c1c15 tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.575s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] volume_snapshot_create: create_info: {'snapshot_id': '628d62a6-624a-4241-97f7-1d5f38c9e6ac', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75734) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 22 15:55:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] snap xml: <domainsnapshot>
Nov 22 15:55:34 user nova-compute[75734]:   <disks>
Nov 22 15:55:34 user nova-compute[75734]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 22 15:55:34 user nova-compute[75734]:       <source file="/dev/new_file"/>
Nov 22 15:55:34 user nova-compute[75734]:     </disk>
Nov 22 15:55:34 user nova-compute[75734]:     <disk name="vda" snapshot="no"/>
Nov 22 15:55:34 user nova-compute[75734]:   </disks>
Nov 22 15:55:34 user nova-compute[75734]: </domainsnapshot>
Nov 22 15:55:34 user nova-compute[75734]:  {{(pid=75734) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 22 15:55:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] Lazy-loading 'system_metadata' on Instance uuid a0dfd979-e5f5-4ca0-b864-90c12641cfe9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 15:55:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-539ea24e-332a-4bbf-8ac5-6e4e7e37cccf tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] volume_snapshot_delete: delete_info: {'volume_id': '16b69e13-36eb-4db1-ae8c-5b2fbaa04edc'} {{(pid=75734) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [None req-539ea24e-332a-4bbf-8ac5-6e4e7e37cccf tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Traceback (most recent call last):
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     if delete_info['type'] != 'qcow2':
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] KeyError: 'type'
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] 
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Traceback (most recent call last):
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     rv = execute(f, *args, **kwargs)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     six.reraise(c, e, tb)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     raise value
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     rv = meth(*args, **kwargs)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] 
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Traceback (most recent call last):
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     self._volume_snapshot_create(context, instance, guest,
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     rv = execute(f, *args, **kwargs)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     six.reraise(c, e, tb)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     raise value
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     rv = meth(*args, **kwargs)
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 15:55:34 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [None req-539ea24e-332a-4bbf-8ac5-6e4e7e37cccf tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f4a607c9-1cf0-43f0-8bda-762653523b42)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server [None req-539ea24e-332a-4bbf-8ac5-6e4e7e37cccf tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] Exception during message handling: KeyError: 'type'
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 628d62a6-624a-4241-97f7-1d5f38c9e6ac could not be found.
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise value
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 628d62a6-624a-4241-97f7-1d5f38c9e6ac could not be found. (HTTP 404) (Request-ID: req-4ddf99a7-adf4-4e6c-bfd7-978b4b0646f4)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 628d62a6-624a-4241-97f7-1d5f38c9e6ac could not be found.
Nov 22 15:55:35 user nova-compute[75734]: ERROR nova.virt.libvirt.driver 
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server [None req-10424ff8-f8c4-4810-b867-14b8c19517e4 tempest-VolumesAssistedSnapshotsTest-1138152135 tempest-VolumesAssistedSnapshotsTest-1138152135-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise value
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 15:55:35 user nova-compute[75734]: ERROR oslo_messaging.rpc.server 
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjhGYrsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e', 'attached_at': '', 'detached_at': '', 'volume_id': '8b43355b-44de-4c94-a8fe-6e262576b260', 'serial': '8b43355b-44de-4c94-a8fe-6e262576b260'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e', 'attached_at': '', 'detached_at': '', 'volume_id': '609d12e6-0cdd-43b1-8917-f28605476935', 'serial'} {{(pid=75734) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjhGYrsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:35 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:35 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:35 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:55:35 user nova-compute[75734]: INFO nova.compute.manager [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Detaching volume 16b69e13-36eb-4db1-ae8c-5b2fbaa04edc
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8c3fb6-4a5c-4262-830a-0615f662c19d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:55:35 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[157e0508-3c39-41b4-99fe-43b29b30e2df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260] added
Nov 22 15:55:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: INFO nova.virt.block_device [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Attempting to driver detach volume 16b69e13-36eb-4db1-ae8c-5b2fbaa04edc from mountpoint /dev/vdb
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5d61ca-45c5-420c-a1cb-d462f720d182]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Attempting to detach device vdb from instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] detach device xml: <disk type="block" device="disk">
Nov 22 15:55:35 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:35 user nova-compute[75734]:   <source dev="/dev/sdk"/>
Nov 22 15:55:35 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:35 user nova-compute[75734]:   <serial>16b69e13-36eb-4db1-ae8c-5b2fbaa04edc</serial>
Nov 22 15:55:35 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:55:35 user nova-compute[75734]: </disk>
Nov 22 15:55:35 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Successfully detached device vdb from instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 from the persistent domain config.
Nov 22 15:55:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] detach device xml: <disk type="block" device="disk">
Nov 22 15:55:35 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:55:35 user nova-compute[75734]:   <source dev="/dev/sdk"/>
Nov 22 15:55:35 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:55:35 user nova-compute[75734]:   <serial>16b69e13-36eb-4db1-ae8c-5b2fbaa04edc</serial>
Nov 22 15:55:35 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:55:35 user nova-compute[75734]: </disk>
Nov 22 15:55:35 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[df82b173-b26b-4f33-967d-4e69d8aeb3b7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjhGYrsJ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjhGYrsJ" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec75d56-1e05-410d-8e7b-3259d59555f6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UjhGYrsJ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fd9dd6-62e3-4202-a56b-9b5b1feb700c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e78c8c5-8979-44d3-949e-f60765080718]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58ebfd9-0f61-4080-8e4e-6ddda0101a01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260]
Nov 22 15:55:35 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[36018187-cf1a-4325-b614-383c0324664b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e50282f-584b-49b6-bced-ba4197f22de5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0434b7-2ed6-4114-a875-23c15b3786ba]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjhGYrsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:55:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23933393762633662', 'path': '/dev/sdl'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933393762633662', 'path': '/dev/sdl'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lazy-loading 'flavor' on Instance uuid a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 is timed out.
Nov 22 15:55:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Successfully detached device vdb from instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 from the live domain config.
Nov 22 15:55:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcflgNOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:36 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f1716b-b2dd-4886-b69e-74b24be4acd7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:55:36 user nova-compute[75734]: No targets found.
Nov 22 15:55:36 user nova-compute[75734]: iSNS:
Nov 22 15:55:36 user nova-compute[75734]: No targets found.
Nov 22 15:55:36 user nova-compute[75734]: STATIC:
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:55:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:36 user nova-compute[75734]: FIRMWARE:
Nov 22 15:55:36 user nova-compute[75734]: No targets found.
Nov 22 15:55:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:55:36 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:55:36 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca79d37-ed6c-4c75-8729-e23d244e98c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1724222-d4e8-47c1-9043-bd568dd63d60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 (non-flash)
Nov 22 15:55:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac78af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4'): ({'sdh'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Removing single pathed devices sdh {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34f829-12d8-4f7e-92c6-a51c7b5fd774]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[81006184-7fd3-477f-a244-557a7d62f318]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Flushing IO for device /dev/sdh {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a24a2f-59dc-43a1-9416-542f28c7038b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a006f97-f8a3-45b9-95a7-9ec0a04de271]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f4de6-5a2f-40f8-ae43-fa11be2a0e76]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a934871-e2ef-4a18-b068-5c228b6067cf]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260]
Nov 22 15:55:37 user nova-compute[75734]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8214f74-e2e0-4be6-b204-9ed5995b7ee4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[764589d0-e365-4087-ba6b-44f92dafb186]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] <== disconnect_volume: return (371ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 95420416 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 95420416 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 191889408 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 191889408 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lazy-loading 'flavor' on Instance uuid 02833b01-4e0b-404a-8aae-d47fa0ac6794 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16234818-564c-4a0b-bc94-7544163ca6ca tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.019s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 296747008 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 349175808 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 526385152 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 687865856 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 813694976 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 953155584 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:43 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a19e33-8f7b-4c1a-bfdb-d9c6b9bfbe92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:55:43 user nova-compute[75734]: No targets found.
Nov 22 15:55:43 user nova-compute[75734]: iSNS:
Nov 22 15:55:43 user nova-compute[75734]: No targets found.
Nov 22 15:55:43 user nova-compute[75734]: STATIC:
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:55:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:43 user nova-compute[75734]: FIRMWARE:
Nov 22 15:55:43 user nova-compute[75734]: No targets found.
Nov 22 15:55:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:55:43 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:55:43 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c73e9a-f0fc-4cf1-ae2a-62b1f1cdd1ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[97407945-8694-4426-8958-eb8523071f74]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7331c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935'): ({'sdi'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Removing single pathed devices sdi {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391e068-0fb2-4575-8392-b726ccd909cd]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dadf73-3d82-44d5-9f11-b830744ecf5e]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Flushing IO for device /dev/sdi {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb3247b-750a-422c-9d8a-206cf1b1b37f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9587ca2-cb55-48f5-ae76-8a3861567ae9]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] SCSI volumes sdi have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb531c-f2b2-4e3c-98e9-c25a7890b6aa]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8d8dc-53be-4dee-b8d2-7fe2b384cd96]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]
Nov 22 15:55:43 user nova-compute[75734]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f101b-9344-4367-99e9-cccfc746e2f2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] <== disconnect_volume: return (399ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjhGYrsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': 'a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e', 'attached_at': '', 'detached_at': '', 'volume_id': '8b43355b-44de-4c94-a8fe-6e262576b260', 'serial'} {{(pid=75734) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] swap_volume: removing Cinder connection for volume 609d12e6-0cdd-43b1-8917-f28605476935 {{(pid=75734) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:55:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] swap_volume: Updating volume 609d12e6-0cdd-43b1-8917-f28605476935 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UjhGYrsJ", "auth_password": "EbuJa9GMc8OXQN", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "8b43355b-44de-4c94-a8fe-6e262576b260"}, "status": "reserved", "instance": "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e", "attached_at": "", "detached_at": "", "volume_id": "8b43355b-44de-4c94-a8fe-6e262576b260", "serial": "8b43355b-44de-4c94-a8fe-6e262576b260"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8b43355b-44de-4c94-a8fe-6e262576b260', 'no_device': None, 'attachment_id': 'b206acec-2b5c-4b20-b5f3-345ac519fdbb'} {{(pid=75734) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a1699cbb-0841-4389-af2d-0ba53a066b47 tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.786s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:45 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:55:45 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:55:45 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7337MB free_disk=25.372100830078125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG os_brick.utils [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7514e03-6fc4-4c55-89ac-ab5b5d865a48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c158823f-476c-4691-9191-affa6e302565 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance bacfbd1d-ad11-486f-bd13-08d72c346b73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e542b93-4c34-4101-ab33-f4dcf81ae00f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16e500-9501-4431-b534-76a8eb30ad9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49fb64e-ad3a-425c-95ab-8ae47e643cb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0816dec-2ff4-4b48-8d6e-396941d0f951]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:55:46 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a57b4-a22f-4e44-8d60-f938fec94703]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG os_brick.utils [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:46 user nova-compute[75734]: INFO nova.compute.manager [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Swapping volume 8b43355b-44de-4c94-a8fe-6e262576b260 for 609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:55:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:55:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:55:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:50 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c158823f-476c-4691-9191-affa6e302565 is timed out.
Nov 22 15:55:50 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully detached device vdb from instance c158823f-476c-4691-9191-affa6e302565 from the live domain config.
Nov 22 15:55:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNgJsZEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:50 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e4197-f890-48fc-babe-54f3b63a7da1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:55:50 user nova-compute[75734]: No targets found.
Nov 22 15:55:50 user nova-compute[75734]: iSNS:
Nov 22 15:55:50 user nova-compute[75734]: No targets found.
Nov 22 15:55:50 user nova-compute[75734]: STATIC:
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:55:50 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:50 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:50 user nova-compute[75734]: FIRMWARE:
Nov 22 15:55:50 user nova-compute[75734]: No targets found.
Nov 22 15:55:50 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:55:50 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:55:50 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241b83b-23ad-4fd5-a66e-da882cc9ccd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[28081693-06e5-4c33-8214-92ca6183997e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:50 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecfe14dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab'): ({'sdj'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Removing single pathed devices sdj {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b723f7-0c30-4a63-8f82-819054f9b3c7]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d51e142-6b47-4efd-b24f-5d1579138766]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Flushing IO for device /dev/sdj {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b88f8ee-fe27-4b6e-92c3-18a6dde129ba]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b7f091-63e1-4cfd-9ea8-628bb591349e]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] SCSI volumes sdj have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b36fe-b3f8-483e-b4ed-c5dd86e27584]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f6dce-4fa9-46d3-a797-254f9bc1913b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260]
Nov 22 15:55:50 user nova-compute[75734]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:50 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcfd34da-7597-4568-b2f9-8dc058a78cab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a22bcc-c7f0-473a-b7dc-b3e41c23f87c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] <== disconnect_volume: return (376ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-changed-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing instance network info cache due to event network-changed-39c27525-cf88-4583-8c07-8cdab0cdca27. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] Acquiring lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] Acquired lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:55:50 user nova-compute[75734]: DEBUG nova.network.neutron [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Refreshing network info cache for port 39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:55:51 user nova-compute[75734]: DEBUG nova.network.neutron [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updated VIF entry in instance network info cache for port 39c27525-cf88-4583-8c07-8cdab0cdca27. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:55:51 user nova-compute[75734]: DEBUG nova.network.neutron [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-093e97f9-6792-405a-affa-8ab00f51390d req-6c7c5ab2-509c-4c97-b7b5-1bd2e48058ba service nova] Releasing lock "refresh_cache-9e542b93-4c34-4101-ab33-f4dcf81ae00f" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:55:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'flavor' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6876f6b9-1680-4b38-9a59-3a975123c3fc tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "interface-c158823f-476c-4691-9191-affa6e302565-cc127665-2c38-4d00-b78d-2e3d0634bc56" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "interface-c158823f-476c-4691-9191-affa6e302565-cc127665-2c38-4d00-b78d-2e3d0634bc56" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.objects.instance [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'flavor' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converting VIF {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface> {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface> {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Attempting to detach device tapcc127665-2c from instance c158823f-476c-4691-9191-affa6e302565 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] detach device xml: <interface type="ethernet">
Nov 22 15:55:52 user nova-compute[75734]:   <mac address="fa:16:3e:0d:e4:79"/>
Nov 22 15:55:52 user nova-compute[75734]:   <model type="virtio"/>
Nov 22 15:55:52 user nova-compute[75734]:   <mtu size="1442"/>
Nov 22 15:55:52 user nova-compute[75734]:   <target dev="tapcc127665-2c"/>
Nov 22 15:55:52 user nova-compute[75734]: </interface>
Nov 22 15:55:52 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface> {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 22 15:55:52 user nova-compute[75734]:   <name>instance-00000006</name>
Nov 22 15:55:52 user nova-compute[75734]:   <uuid>c158823f-476c-4691-9191-affa6e302565</uuid>
Nov 22 15:55:52 user nova-compute[75734]:   <metadata>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:55:52 user nova-compute[75734]:   <nova:package version="0.0.0"/>
Nov 22 15:55:52 user nova-compute[75734]:   <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:55:52 user nova-compute[75734]:   <nova:creationTime>2023-11-22 15:55:13</nova:creationTime>
Nov 22 15:55:52 user nova-compute[75734]:   <nova:flavor name="m1.tiny">
Nov 22 15:55:52 user nova-compute[75734]:     <nova:memory>512</nova:memory>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:disk>1</nova:disk>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:swap>0</nova:swap>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:vcpus>1</nova:vcpus>
Nov 22 15:55:52 user nova-compute[75734]:   </nova:flavor>
Nov 22 15:55:52 user nova-compute[75734]:   <nova:owner>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:55:52 user nova-compute[75734]:   </nova:owner>
Nov 22 15:55:52 user nova-compute[75734]:   <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:55:52 user nova-compute[75734]:   <nova:ports>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:55:52 user nova-compute[75734]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:55:52 user nova-compute[75734]:     </nova:port>
Nov 22 15:55:52 user nova-compute[75734]:     <nova:port uuid="cc127665-2c38-4d00-b78d-2e3d0634bc56">
Nov 22 15:55:52 user nova-compute[75734]:       <nova:ip type="fixed" address="10.10.10.164" ipVersion="4"/>
Nov 22 15:55:52 user nova-compute[75734]:     </nova:port>
Nov 22 15:55:52 user nova-compute[75734]:   </nova:ports>
Nov 22 15:55:52 user nova-compute[75734]: </nova:instance>
Nov 22 15:55:52 user nova-compute[75734]:   </metadata>
Nov 22 15:55:52 user nova-compute[75734]:   <memory unit='KiB'>524288</memory>
Nov 22 15:55:52 user nova-compute[75734]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 15:55:52 user nova-compute[75734]:   <vcpu placement='static'>1</vcpu>
Nov 22 15:55:52 user nova-compute[75734]:   <resource>
Nov 22 15:55:52 user nova-compute[75734]:     <partition>/machine</partition>
Nov 22 15:55:52 user nova-compute[75734]:   </resource>
Nov 22 15:55:52 user nova-compute[75734]:   <sysinfo type='smbios'>
Nov 22 15:55:52 user nova-compute[75734]:     <system>
Nov 22 15:55:52 user nova-compute[75734]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 15:55:52 user nova-compute[75734]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 15:55:52 user nova-compute[75734]:       <entry name='version'>0.0.0</entry>
Nov 22 15:55:52 user nova-compute[75734]:       <entry name='serial'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:55:52 user nova-compute[75734]:       <entry name='uuid'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:55:52 user nova-compute[75734]:       <entry name='family'>Virtual Machine</entry>
Nov 22 15:55:52 user nova-compute[75734]:     </system>
Nov 22 15:55:52 user nova-compute[75734]:   </sysinfo>
Nov 22 15:55:52 user nova-compute[75734]:   <os>
Nov 22 15:55:52 user nova-compute[75734]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 15:55:52 user nova-compute[75734]:     <boot dev='hd'/>
Nov 22 15:55:52 user nova-compute[75734]:     <smbios mode='sysinfo'/>
Nov 22 15:55:52 user nova-compute[75734]:   </os>
Nov 22 15:55:52 user nova-compute[75734]:   <features>
Nov 22 15:55:52 user nova-compute[75734]:     <acpi/>
Nov 22 15:55:52 user nova-compute[75734]:     <apic/>
Nov 22 15:55:52 user nova-compute[75734]:     <vmcoreinfo state='on'/>
Nov 22 15:55:52 user nova-compute[75734]:   </features>
Nov 22 15:55:52 user nova-compute[75734]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 15:55:52 user nova-compute[75734]:     <model fallback='forbid'>Nehalem</model>
Nov 22 15:55:52 user nova-compute[75734]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 15:55:52 user nova-compute[75734]:     <feature policy='require' name='vme'/>
Nov 22 15:55:52 user nova-compute[75734]:     <feature policy='require' name='x2apic'/>
Nov 22 15:55:52 user nova-compute[75734]:     <feature policy='require' name='hypervisor'/>
Nov 22 15:55:52 user nova-compute[75734]:   </cpu>
Nov 22 15:55:52 user nova-compute[75734]:   <clock offset='utc'>
Nov 22 15:55:52 user nova-compute[75734]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 15:55:52 user nova-compute[75734]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 15:55:52 user nova-compute[75734]:     <timer name='hpet' present='no'/>
Nov 22 15:55:52 user nova-compute[75734]:   </clock>
Nov 22 15:55:52 user nova-compute[75734]:   <on_poweroff>destroy</on_poweroff>
Nov 22 15:55:52 user nova-compute[75734]:   <on_reboot>restart</on_reboot>
Nov 22 15:55:52 user nova-compute[75734]:   <on_crash>destroy</on_crash>
Nov 22 15:55:52 user nova-compute[75734]:   <devices>
Nov 22 15:55:52 user nova-compute[75734]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 15:55:52 user nova-compute[75734]:     <disk type='file' device='disk'>
Nov 22 15:55:52 user nova-compute[75734]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 15:55:52 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk' index='2'/>
Nov 22 15:55:52 user nova-compute[75734]:       <backingStore type='file' index='3'>
Nov 22 15:55:52 user nova-compute[75734]:         <format type='raw'/>
Nov 22 15:55:52 user nova-compute[75734]:         <source file='/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544'/>
Nov 22 15:55:52 user nova-compute[75734]:         <backingStore/>
Nov 22 15:55:52 user nova-compute[75734]:       </backingStore>
Nov 22 15:55:52 user nova-compute[75734]:       <target dev='vda' bus='virtio'/>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='virtio-disk0'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </disk>
Nov 22 15:55:52 user nova-compute[75734]:     <disk type='file' device='cdrom'>
Nov 22 15:55:52 user nova-compute[75734]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 15:55:52 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config' index='1'/>
Nov 22 15:55:52 user nova-compute[75734]:       <backingStore/>
Nov 22 15:55:52 user nova-compute[75734]:       <target dev='hda' bus='ide'/>
Nov 22 15:55:52 user nova-compute[75734]:       <readonly/>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='ide0-0-0'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </disk>
Nov 22 15:55:52 user nova-compute[75734]:     <controller type='usb' index='0' model='none'>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='usb'/>
Nov 22 15:55:52 user nova-compute[75734]:     </controller>
Nov 22 15:55:52 user nova-compute[75734]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='pci.0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </controller>
Nov 22 15:55:52 user nova-compute[75734]:     <controller type='ide' index='0'>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='ide'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 15:55:52 user nova-compute[75734]:     </controller>
Nov 22 15:55:52 user nova-compute[75734]:     <interface type='ethernet'>
Nov 22 15:55:52 user nova-compute[75734]:       <mac address='fa:16:3e:0f:10:66'/>
Nov 22 15:55:52 user nova-compute[75734]:       <target dev='tap22d78f0a-27'/>
Nov 22 15:55:52 user nova-compute[75734]:       <model type='virtio'/>
Nov 22 15:55:52 user nova-compute[75734]:       <mtu size='1442'/>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='net0'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </interface>
Nov 22 15:55:52 user nova-compute[75734]:     <interface type='ethernet'>
Nov 22 15:55:52 user nova-compute[75734]:       <mac address='fa:16:3e:0d:e4:79'/>
Nov 22 15:55:52 user nova-compute[75734]:       <target dev='tapcc127665-2c'/>
Nov 22 15:55:52 user nova-compute[75734]:       <model type='virtio'/>
Nov 22 15:55:52 user nova-compute[75734]:       <mtu size='1442'/>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='net1'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </interface>
Nov 22 15:55:52 user nova-compute[75734]:     <serial type='pty'>
Nov 22 15:55:52 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:55:52 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:55:52 user nova-compute[75734]:       <target type='isa-serial' port='0'>
Nov 22 15:55:52 user nova-compute[75734]:         <model name='isa-serial'/>
Nov 22 15:55:52 user nova-compute[75734]:       </target>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </serial>
Nov 22 15:55:52 user nova-compute[75734]:     <console type='pty' tty='/dev/pts/5'>
Nov 22 15:55:52 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:55:52 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:55:52 user nova-compute[75734]:       <target type='serial' port='0'/>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </console>
Nov 22 15:55:52 user nova-compute[75734]:     <input type='mouse' bus='ps2'>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='input0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </input>
Nov 22 15:55:52 user nova-compute[75734]:     <input type='keyboard' bus='ps2'>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='input1'/>
Nov 22 15:55:52 user nova-compute[75734]:     </input>
Nov 22 15:55:52 user nova-compute[75734]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 22 15:55:52 user nova-compute[75734]:       <listen type='address' address='0.0.0.0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </graphics>
Nov 22 15:55:52 user nova-compute[75734]:     <audio id='1' type='none'/>
Nov 22 15:55:52 user nova-compute[75734]:     <video>
Nov 22 15:55:52 user nova-compute[75734]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='video0'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </video>
Nov 22 15:55:52 user nova-compute[75734]:     <memballoon model='virtio'>
Nov 22 15:55:52 user nova-compute[75734]:       <stats period='10'/>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='balloon0'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </memballoon>
Nov 22 15:55:52 user nova-compute[75734]:     <rng model='virtio'>
Nov 22 15:55:52 user nova-compute[75734]:       <backend model='random'>/dev/urandom</backend>
Nov 22 15:55:52 user nova-compute[75734]:       <alias name='rng0'/>
Nov 22 15:55:52 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 15:55:52 user nova-compute[75734]:     </rng>
Nov 22 15:55:52 user nova-compute[75734]:   </devices>
Nov 22 15:55:52 user nova-compute[75734]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 15:55:52 user nova-compute[75734]:     <label>libvirt-c158823f-476c-4691-9191-affa6e302565</label>
Nov 22 15:55:52 user nova-compute[75734]:     <imagelabel>libvirt-c158823f-476c-4691-9191-affa6e302565</imagelabel>
Nov 22 15:55:52 user nova-compute[75734]:   </seclabel>
Nov 22 15:55:52 user nova-compute[75734]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 15:55:52 user nova-compute[75734]:     <label>+64055:+108</label>
Nov 22 15:55:52 user nova-compute[75734]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 15:55:52 user nova-compute[75734]:   </seclabel>
Nov 22 15:55:52 user nova-compute[75734]: </domain>
Nov 22 15:55:52 user nova-compute[75734]:  {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 15:55:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully detached device tapcc127665-2c from instance c158823f-476c-4691-9191-affa6e302565 from the persistent domain config.
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] (1/8): Attempting to detach device tapcc127665-2c with device alias net1 from instance c158823f-476c-4691-9191-affa6e302565 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] detach device xml: <interface type="ethernet">
Nov 22 15:55:52 user nova-compute[75734]:   <mac address="fa:16:3e:0d:e4:79"/>
Nov 22 15:55:52 user nova-compute[75734]:   <model type="virtio"/>
Nov 22 15:55:52 user nova-compute[75734]:   <mtu size="1442"/>
Nov 22 15:55:52 user nova-compute[75734]:   <target dev="tapcc127665-2c"/>
Nov 22 15:55:52 user nova-compute[75734]: </interface>
Nov 22 15:55:52 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Start waiting for the detach event from libvirt for device tapcc127665-2c with device alias net1 for instance c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-2488ba2a-1b7f-4f6c-a0c1-fb0baba6e4b2 req-afdfb970-5e3a-4756-ba7a-0ddc294f6fc7 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-unplugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2488ba2a-1b7f-4f6c-a0c1-fb0baba6e4b2 req-afdfb970-5e3a-4756-ba7a-0ddc294f6fc7 service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2488ba2a-1b7f-4f6c-a0c1-fb0baba6e4b2 req-afdfb970-5e3a-4756-ba7a-0ddc294f6fc7 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2488ba2a-1b7f-4f6c-a0c1-fb0baba6e4b2 req-afdfb970-5e3a-4756-ba7a-0ddc294f6fc7 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-2488ba2a-1b7f-4f6c-a0c1-fb0baba6e4b2 req-afdfb970-5e3a-4756-ba7a-0ddc294f6fc7 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-unplugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:52 user nova-compute[75734]: WARNING nova.compute.manager [req-2488ba2a-1b7f-4f6c-a0c1-fb0baba6e4b2 req-afdfb970-5e3a-4756-ba7a-0ddc294f6fc7 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received unexpected event network-vif-unplugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 for instance with vm_state active and task_state None.
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:53 user nova-compute[75734]: INFO nova.compute.manager [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Terminating instance
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e', 'attached_at': '', 'detached_at': '', 'volume_id': '609d12e6-0cdd-43b1-8917-f28605476935', 'serial': '609d12e6-0cdd-43b1-8917-f28605476935'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjhGYrsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '8b43355b-44de-4c94-a8fe-6e262576b260'}, 'status': 'reserved', 'instance': 'a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e', 'attached_at': '', 'detached_at': '', 'volume_id': '8b43355b-44de-4c94-a8fe-6e262576b260', 'serial'} {{(pid=75734) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:53 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:53 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:53 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[30524337-f7ce-4127-b105-d22242400f6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:55:53 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[207a4cf7-b8ee-454b-86ae-5da0b63095ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935] added
Nov 22 15:55:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13c7359-c3d7-4853-84bf-8442339e3b02]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ec6c5-2147-47ff-b1a8-a44ad81e5aec]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvVaiukp {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvVaiukp" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a64a20-deb6-4795-94db-ff711b7e5305]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zvVaiukp'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7614f68-8c0b-4465-b030-7b6bce952789]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c07591c-fefa-4357-be64-34ddd81708d5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-4096b76a-4d95-4d36-9bf8-4ca73418a3e8 req-4abcccff-5db3-4dea-b7f5-12d18ac56d81 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4096b76a-4d95-4d36-9bf8-4ca73418a3e8 req-4abcccff-5db3-4dea-b7f5-12d18ac56d81 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4096b76a-4d95-4d36-9bf8-4ca73418a3e8 req-4abcccff-5db3-4dea-b7f5-12d18ac56d81 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4096b76a-4d95-4d36-9bf8-4ca73418a3e8 req-4abcccff-5db3-4dea-b7f5-12d18ac56d81 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-4096b76a-4d95-4d36-9bf8-4ca73418a3e8 req-4abcccff-5db3-4dea-b7f5-12d18ac56d81 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-unplugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-4096b76a-4d95-4d36-9bf8-4ca73418a3e8 req-4abcccff-5db3-4dea-b7f5-12d18ac56d81 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-a138724e-1f59-40a4-9e47-a19cc86c196f for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a4bc8d-bcd5-497d-ab17-29037f05703c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]
Nov 22 15:55:53 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[26245268-0bb8-4375-a4ba-e709f11c2ad8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ba5733-bf94-4ab6-9a7b-ce0b74f94299]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-0189364e-42d0-4b4f-8445-167ccf21f975 req-23296136-c004-4e09-a1fc-285a072085e9 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0189364e-42d0-4b4f-8445-167ccf21f975 req-23296136-c004-4e09-a1fc-285a072085e9 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0189364e-42d0-4b4f-8445-167ccf21f975 req-23296136-c004-4e09-a1fc-285a072085e9 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0189364e-42d0-4b4f-8445-167ccf21f975 req-23296136-c004-4e09-a1fc-285a072085e9 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-0189364e-42d0-4b4f-8445-167ccf21f975 req-23296136-c004-4e09-a1fc-285a072085e9 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-unplugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-0189364e-42d0-4b4f-8445-167ccf21f975 req-23296136-c004-4e09-a1fc-285a072085e9 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[54424303-84cd-4e92-a82c-192d11040db1]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:55:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23036616336313638', 'path': '/dev/sdh'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036616336313638', 'path': '/dev/sdh'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:55:54 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lazy-loading 'flavor' on Instance uuid a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received unexpected event network-vif-plugged-cc127665-2c38-4d00-b78d-2e3d0634bc56 for instance with vm_state active and task_state None.
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-unplugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-39c27525-cf88-4583-8c07-8cdab0cdca27 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-39c27525-cf88-4583-8c07-8cdab0cdca27 for instance with vm_state active and task_state deleting.
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-unplugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-419fbf39-7481-4732-967a-68f6b6b8babb for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-419fbf39-7481-4732-967a-68f6b6b8babb for instance with vm_state active and task_state deleting.
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-unplugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-497f029a-269b-4f86-8af0-20dca2bfea98 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING nova.compute.manager [req-2da8fb7d-d397-4cf0-a1e4-9504d104507a req-5964108c-987e-47f1-8641-a4a50b0c03a6 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-497f029a-269b-4f86-8af0-20dca2bfea98 for instance with vm_state active and task_state deleting.
Nov 22 15:55:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Instance destroyed successfully.
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.objects.instance [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lazy-loading 'resources' on Instance uuid 9e542b93-4c34-4101-ab33-f4dcf81ae00f {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:b1:77,bridge_name='br-int',has_traffic_filtering=True,id=39c27525-cf88-4583-8c07-8cdab0cdca27,network=Network(757e9aca-c4b9-467f-8652-2d3bd60bdb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c27525-cf') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:b1:77,bridge_name='br-int',has_traffic_filtering=True,id=39c27525-cf88-4583-8c07-8cdab0cdca27,network=Network(757e9aca-c4b9-467f-8652-2d3bd60bdb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c27525-cf') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39c27525-cf, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48f30cd0-c61d-4ff2-a490-25afcce313ff) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: INFO os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:b1:77,bridge_name='br-int',has_traffic_filtering=True,id=39c27525-cf88-4583-8c07-8cdab0cdca27,network=Network(757e9aca-c4b9-467f-8652-2d3bd60bdb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c27525-cf')
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=a138724e-1f59-40a4-9e47-a19cc86c196f,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa138724e-1f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=a138724e-1f59-40a4-9e47-a19cc86c196f,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa138724e-1f') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa138724e-1f, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95c03ac9-a620-4d83-ba45-4876114f5545) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: INFO os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=a138724e-1f59-40a4-9e47-a19cc86c196f,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa138724e-1f')
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e7:ff,bridge_name='br-int',has_traffic_filtering=True,id=5ff4df5f-7b8c-40cf-81a7-a4b4e959c136,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ff4df5f-7b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e7:ff,bridge_name='br-int',has_traffic_filtering=True,id=5ff4df5f-7b8c-40cf-81a7-a4b4e959c136,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ff4df5f-7b') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ff4df5f-7b, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7db6c982-f978-4f79-b4e2-659d547b1021) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: INFO os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e7:ff,bridge_name='br-int',has_traffic_filtering=True,id=5ff4df5f-7b8c-40cf-81a7-a4b4e959c136,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ff4df5f-7b')
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "address": "fa:16:3e:22:e2:aa", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3701ba1e-8a", "ovs_interfaceid": "3701ba1e-8a6d-4f04-841c-de6e6e7e1060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3701ba1e-8a') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3701ba1e-8a') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3701ba1e-8a, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65728585-953d-4138-b901-306eabf2ef8e) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: INFO os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:aa,bridge_name='br-int',has_traffic_filtering=True,id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3701ba1e-8a')
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bb:60,bridge_name='br-int',has_traffic_filtering=True,id=419fbf39-7481-4732-967a-68f6b6b8babb,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fbf39-74') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bb:60,bridge_name='br-int',has_traffic_filtering=True,id=419fbf39-7481-4732-967a-68f6b6b8babb,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fbf39-74') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap419fbf39-74, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ae0069b-5dd5-43af-8927-1c53295a4d7f) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: INFO os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bb:60,bridge_name='br-int',has_traffic_filtering=True,id=419fbf39-7481-4732-967a-68f6b6b8babb,network=Network(9274ad78-9db6-4d77-81bd-153ccafd56da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fbf39-74')
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b8:e7,bridge_name='br-int',has_traffic_filtering=True,id=497f029a-269b-4f86-8af0-20dca2bfea98,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497f029a-26') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b8:e7,bridge_name='br-int',has_traffic_filtering=True,id=497f029a-269b-4f86-8af0-20dca2bfea98,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497f029a-26') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap497f029a-26, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a37f9dc-2f79-4586-b7af-b13d8087235d) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: INFO os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b8:e7,bridge_name='br-int',has_traffic_filtering=True,id=497f029a-269b-4f86-8af0-20dca2bfea98,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497f029a-26')
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1178668050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1178668050',id=9,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPfh62JIO1z9fp0F0SXukCeDd/opZaJo8td+bBCnW25zawuvivZW7moDEkUmN78yn5uuD5g57dYv/75mu1+qULt51GWf0SxxxE28WVO+mdZwHWwHmq7DxdC3d/hS3m95A==',key_name='tempest-keypair-821915501',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f581c58e0e0a4eecb93cc79f06560278',ramdisk_id='',reservation_id='r-vjj1r3vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157696607',owner_user_name='tempest-TaggedBootDevicesTest-157696607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1960e1acc3ed440c8b1b3da8a5b38cfe',uuid=9e542b93-4c34-4101-ab33-f4dcf81ae00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converting VIF {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:54:68,bridge_name='br-int',has_traffic_filtering=True,id=e4411fda-4320-4391-83d8-8b8f47250ed3,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4411fda-43') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:54:68,bridge_name='br-int',has_traffic_filtering=True,id=e4411fda-4320-4391-83d8-8b8f47250ed3,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4411fda-43') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4411fda-43, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c6def00-e123-474b-ab56-a8713425a7b0) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:55:55 user nova-compute[75734]: INFO os_vif [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:54:68,bridge_name='br-int',has_traffic_filtering=True,id=e4411fda-4320-4391-83d8-8b8f47250ed3,network=Network(22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4411fda-43')
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIbQSTWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-a138724e-1f59-40a4-9e47-a19cc86c196f for instance with vm_state active and task_state deleting.
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-unplugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING nova.compute.manager [req-ee16009e-a0a7-4eea-bf2e-417bcfce1c5e req-85b8e5ad-40d2-4810-9ba1-56afdf8b3424 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 for instance with vm_state active and task_state deleting.
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f3efe-10fe-4626-b73c-e4fa8cae0934]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:55:55 user nova-compute[75734]: No targets found.
Nov 22 15:55:55 user nova-compute[75734]: iSNS:
Nov 22 15:55:55 user nova-compute[75734]: No targets found.
Nov 22 15:55:55 user nova-compute[75734]: STATIC:
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:55:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:55 user nova-compute[75734]: FIRMWARE:
Nov 22 15:55:55 user nova-compute[75734]: No targets found.
Nov 22 15:55:55 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:55:55 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:55:55 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f77b48b-cf4f-4ebc-84fb-6cc4d20a3f4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:55 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 is timed out.
Nov 22 15:55:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Successfully detached device vdb from instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 from the live domain config.
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd71e5c-f19e-4765-9ffd-18e5e43e60dd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:55 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc3d56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:55:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghocpLMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:56 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d942045-b693-45e2-982a-bff661ee75b1]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:56 user nova-compute[75734]: WARNING nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-5ff4df5f-7b8c-40cf-81a7-a4b4e959c136 for instance with vm_state active and task_state deleting.
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-unplugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-unplugged-e4411fda-4320-4391-83d8-8b8f47250ed3 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Acquiring lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] No waiting events found dispatching network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:55:56 user nova-compute[75734]: WARNING nova.compute.manager [req-f8e62c6a-0d55-4f44-b195-f2505cbbb227 req-684d7c24-8233-4ea4-ad82-1c7895df5c1e service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received unexpected event network-vif-plugged-e4411fda-4320-4391-83d8-8b8f47250ed3 for instance with vm_state active and task_state deleting.
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc01675-74f0-411e-840b-a801e9e9204a]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4137145d-b10a-4490-bea5-3af36cc0b824]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[02247b90-8446-44bd-8b2f-2f2be1fe0f7a]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1b813e-3560-4af8-a2b9-27e89248abd8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8686069-6f63-47d7-b15b-e35a20f00340]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260]
Nov 22 15:55:56 user nova-compute[75734]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878ca599-df98-46a0-a1d3-8de3d65e6d32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.059s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e0c35e-f2f1-4840-848d-3942e5d7f666]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== disconnect_volume: return (469ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.312s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWeaDHuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:56 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c98f92-7fcf-4a20-ad9a-e70eb8d4ce7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:55:56 user nova-compute[75734]: No targets found.
Nov 22 15:55:56 user nova-compute[75734]: iSNS:
Nov 22 15:55:56 user nova-compute[75734]: No targets found.
Nov 22 15:55:56 user nova-compute[75734]: STATIC:
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: FIRMWARE:
Nov 22 15:55:56 user nova-compute[75734]: No targets found.
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:55:56 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:55:56 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5142b45e-b76f-473c-bac3-8177597acee6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f459ae9c-8c05-4a51-ae3e-28e01000498b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc2075b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc'): ({'sdk'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Removing single pathed devices sdk {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17b7944-2d30-4332-80d4-e085acf2890e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e4da89-ede1-4000-9b2d-ca259f048693]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Flushing IO for device /dev/sdk {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[13901dcc-6b68-481b-8215-62cfe1c6a1cd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 214958080 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.042s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d26a6-8660-4bb6-b759-8f3f0b093a1e]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] SCSI volumes sdk have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e324c1c8-aba1-4af4-9099-487c3fbfa226]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a13ce97-d424-47bd-837a-14c48932fc39]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260]
Nov 22 15:55:56 user nova-compute[75734]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b69e13-36eb-4db1-ae8c-5b2fbaa04edc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8375bd-6cfa-4cbf-94d7-c4eb44f6f7d6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] <== disconnect_volume: return (691ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.384s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a854c64-7872-4a38-ad16-5dd76bbd2f65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:55:56 user nova-compute[75734]: No targets found.
Nov 22 15:55:56 user nova-compute[75734]: iSNS:
Nov 22 15:55:56 user nova-compute[75734]: No targets found.
Nov 22 15:55:56 user nova-compute[75734]: STATIC:
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:55:56 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:56 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:56 user nova-compute[75734]: FIRMWARE:
Nov 22 15:55:56 user nova-compute[75734]: No targets found.
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:55:56 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:55:56 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b38085-747b-4e9f-a12d-c8b155263172]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2e7ab-9b43-4aae-b735-44dc50f69043]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac733ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d3cdd-f34b-4875-9582-bcaff52f914e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a281378-de3b-459f-9a35-86d6bbac5618]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c28ec1e-3ae3-43ce-b816-47203f5e59dc]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc523fea-14a2-4889-8ba7-e3d74283f3ae]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc62d2-3305-48b8-9842-c40a42f38da8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e59846-f7d2-4b3e-8ae1-88ef5626617f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260]
Nov 22 15:55:57 user nova-compute[75734]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 348127232 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19ba00f-48ad-4766-b7e5-10cdbeba2986 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a143ed53-f7fd-42fd-95f5-a16e3a27da2e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== disconnect_volume: return (742ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIXAVtiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:55:57 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d4f4d-7b92-470f-83fa-954b6cc1f980]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:55:57 user nova-compute[75734]: No targets found.
Nov 22 15:55:57 user nova-compute[75734]: iSNS:
Nov 22 15:55:57 user nova-compute[75734]: No targets found.
Nov 22 15:55:57 user nova-compute[75734]: STATIC:
Nov 22 15:55:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:55:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:55:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:55:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:55:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489
Nov 22 15:55:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:55:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:55:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:55:57 user nova-compute[75734]: FIRMWARE:
Nov 22 15:55:57 user nova-compute[75734]: No targets found.
Nov 22 15:55:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:55:57 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:55:57 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d2a60-6202-4be3-b149-8a93369808c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e941a2-10a7-438c-9d78-1938ec4d4d54]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:55:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac732830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489'): ({'sdd'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Removing single pathed devices sdd {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa3150-f5bb-4848-9df4-53e458287976]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1b6fa3-82d6-420c-bc70-4a3e8de4faac]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Flushing IO for device /dev/sdd {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeb53f2-8aef-42d3-867a-c195a23cb064]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[642563e8-ad6b-4d28-8566-ae459e8e3a8a]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c11d0-dc7a-4bd3-836a-a51619b94a08]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b243e3a2-6e65-4209-a680-afddbcf15c28]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260]
Nov 22 15:55:57 user nova-compute[75734]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489, portal: 172.16.0.220,3260] successful.
Nov 22 15:55:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ce674-60f6-4086-9972-f4670cd7d489 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafad3b3-c8f5-450f-a9e0-b703284fb209]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] <== disconnect_volume: return (310ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:55:57 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Deleting instance files /opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f_del
Nov 22 15:55:57 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Deletion of /opt/stack/data/nova/instances/9e542b93-4c34-4101-ab33-f4dcf81ae00f_del complete
Nov 22 15:55:57 user nova-compute[75734]: INFO nova.compute.manager [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Took 4.11 seconds to destroy the instance on the hypervisor.
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 406847488 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG nova.objects.instance [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lazy-loading 'flavor' on Instance uuid a0dfd979-e5f5-4ca0-b864-90c12641cfe9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:55:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5f0ff6b4-e6aa-4dde-8f8b-0e16b66490fb tempest-VolumesAssistedSnapshotsTest-1249241107 tempest-VolumesAssistedSnapshotsTest-1249241107-project-admin] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.434s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:55:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 563085312 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 742391808 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 912261120 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 1068498944 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:55:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-b7b9366e-7434-4324-ba47-d740158a3e21 req-080cf167-3c8f-4e2d-9a50-85f567c224e8 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-deleted-3701ba1e-8a6d-4f04-841c-de6e6e7e1060 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:55:59 user nova-compute[75734]: INFO nova.compute.manager [req-b7b9366e-7434-4324-ba47-d740158a3e21 req-080cf167-3c8f-4e2d-9a50-85f567c224e8 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Neutron deleted interface 3701ba1e-8a6d-4f04-841c-de6e6e7e1060; detaching it from the instance and deleting it from the info cache
Nov 22 15:55:59 user nova-compute[75734]: DEBUG nova.network.neutron [req-b7b9366e-7434-4324-ba47-d740158a3e21 req-080cf167-3c8f-4e2d-9a50-85f567c224e8 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "39c27525-cf88-4583-8c07-8cdab0cdca27", "address": "fa:16:3e:9f:b1:77", "network": {"id": "757e9aca-c4b9-467f-8652-2d3bd60bdb95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-928988658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c27525-cf", "ovs_interfaceid": "39c27525-cf88-4583-8c07-8cdab0cdca27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:55:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-b7b9366e-7434-4324-ba47-d740158a3e21 req-080cf167-3c8f-4e2d-9a50-85f567c224e8 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Detach interface failed, port_id=3701ba1e-8a6d-4f04-841c-de6e6e7e1060, reason: Instance 9e542b93-4c34-4101-ab33-f4dcf81ae00f could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjhGYrsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '8b43355b-44de-4c94-a8fe-6e262576b260'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:00 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75e4685-8b2e-423b-b59c-cafbea851243]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:56:00 user nova-compute[75734]: No targets found.
Nov 22 15:56:00 user nova-compute[75734]: iSNS:
Nov 22 15:56:00 user nova-compute[75734]: No targets found.
Nov 22 15:56:00 user nova-compute[75734]: STATIC:
Nov 22 15:56:00 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:56:00 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:00 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:00 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260
Nov 22 15:56:00 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:00 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:00 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:56:00 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:00 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:00 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:56:00 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:00 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:00 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:56:00 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:00 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:00 user nova-compute[75734]: FIRMWARE:
Nov 22 15:56:00 user nova-compute[75734]: No targets found.
Nov 22 15:56:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:56:00 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:56:00 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1876e1f3-67e6-4242-b083-65986dd6abeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c8b84e-524f-42b0-af80-54aaf03d2c32]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecfe15120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260'): ({'sdl'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Removing single pathed devices sdl {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c8726f-234a-4a38-9573-6fb449403495]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7377d123-7e6e-41f5-96d2-9f4688b58986]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Flushing IO for device /dev/sdl {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a5eb81-de3d-4966-ab01-3a4ca2512770]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.242s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b04153c-dc3d-43a8-a747-a7c04a1652bb]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] SCSI volumes sdl have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8371003d-31ca-4f1c-bcf1-e5cf0ea2beab]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b1972-d889-4bee-8327-ad3d7e64931a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260]
Nov 22 15:56:00 user nova-compute[75734]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b43355b-44de-4c94-a8fe-6e262576b260 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00862dc-496c-4919-94e1-3f5a666a6e27]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.541s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] <== disconnect_volume: return (543ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e', 'attached_at': '', 'detached_at': '', 'volume_id': '609d12e6-0cdd-43b1-8917-f28605476935', 'serial'} {{(pid=75734) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] swap_volume: removing Cinder connection for volume 8b43355b-44de-4c94-a8fe-6e262576b260 {{(pid=75734) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 22 15:56:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] swap_volume: Updating volume 8b43355b-44de-4c94-a8fe-6e262576b260 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zvVaiukp", "auth_password": "5is3IcLlFeHUoQ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "609d12e6-0cdd-43b1-8917-f28605476935"}, "status": "reserved", "instance": "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e", "attached_at": "", "detached_at": "", "volume_id": "609d12e6-0cdd-43b1-8917-f28605476935", "serial": "609d12e6-0cdd-43b1-8917-f28605476935"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '609d12e6-0cdd-43b1-8917-f28605476935', 'no_device': None, 'attachment_id': '33bfccde-eb54-4484-ad51-f46e13f97e7a'} {{(pid=75734) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1fec324a-90dc-43b3-8f6b-fd5d0c8feb5a tempest-TestVolumeSwap-1126092790 tempest-TestVolumeSwap-1126092790-project-admin] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.577s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-deleted-39c27525-cf88-4583-8c07-8cdab0cdca27 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:01 user nova-compute[75734]: INFO nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Neutron deleted interface 39c27525-cf88-4583-8c07-8cdab0cdca27; detaching it from the instance and deleting it from the info cache
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497f029a-269b-4f86-8af0-20dca2bfea98", "address": "fa:16:3e:20:b8:e7", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497f029a-26", "ovs_interfaceid": "497f029a-269b-4f86-8af0-20dca2bfea98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Detach interface failed, port_id=39c27525-cf88-4583-8c07-8cdab0cdca27, reason: Instance 9e542b93-4c34-4101-ab33-f4dcf81ae00f could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-deleted-497f029a-269b-4f86-8af0-20dca2bfea98 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:01 user nova-compute[75734]: INFO nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Neutron deleted interface 497f029a-269b-4f86-8af0-20dca2bfea98; detaching it from the instance and deleting it from the info cache
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "419fbf39-7481-4732-967a-68f6b6b8babb", "address": "fa:16:3e:9e:bb:60", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fbf39-74", "ovs_interfaceid": "419fbf39-7481-4732-967a-68f6b6b8babb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Detach interface failed, port_id=497f029a-269b-4f86-8af0-20dca2bfea98, reason: Instance 9e542b93-4c34-4101-ab33-f4dcf81ae00f could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-deleted-419fbf39-7481-4732-967a-68f6b6b8babb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:01 user nova-compute[75734]: INFO nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Neutron deleted interface 419fbf39-7481-4732-967a-68f6b6b8babb; detaching it from the instance and deleting it from the info cache
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [{"id": "a138724e-1f59-40a4-9e47-a19cc86c196f", "address": "fa:16:3e:d5:b6:d4", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa138724e-1f", "ovs_interfaceid": "a138724e-1f59-40a4-9e47-a19cc86c196f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "address": "fa:16:3e:a5:e7:ff", "network": {"id": "9274ad78-9db6-4d77-81bd-153ccafd56da", "bridge": "br-int", "label": "tempest-device-tagging-net1-1707413481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff4df5f-7b", "ovs_interfaceid": "5ff4df5f-7b8c-40cf-81a7-a4b4e959c136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4411fda-4320-4391-83d8-8b8f47250ed3", "address": "fa:16:3e:15:54:68", "network": {"id": "22a3ac2d-3c5e-4f11-97a9-7cfeb9f870a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132899330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f581c58e0e0a4eecb93cc79f06560278", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4411fda-43", "ovs_interfaceid": "e4411fda-4320-4391-83d8-8b8f47250ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc5ff7e-6df4-40fd-820b-3759b92b4bcb req-c7b88416-33d1-4948-b82c-6bb5d8b0a1e4 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Detach interface failed, port_id=419fbf39-7481-4732-967a-68f6b6b8babb, reason: Instance 9e542b93-4c34-4101-ab33-f4dcf81ae00f could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:56:01 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:01 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Took 4.51 seconds to deallocate network for instance.
Nov 22 15:56:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:02 user nova-compute[75734]: INFO nova.compute.manager [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Detaching volume 609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:56:02 user nova-compute[75734]: INFO nova.virt.block_device [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Attempting to driver detach volume 609d12e6-0cdd-43b1-8917-f28605476935 from mountpoint /dev/vdb
Nov 22 15:56:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Attempting to detach device vdb from instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:56:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:56:02 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:56:02 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:56:02 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:56:02 user nova-compute[75734]:   <serial>609d12e6-0cdd-43b1-8917-f28605476935</serial>
Nov 22 15:56:02 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:56:02 user nova-compute[75734]: </disk>
Nov 22 15:56:02 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:56:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Successfully detached device vdb from instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e from the persistent domain config.
Nov 22 15:56:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:56:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:56:02 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:56:02 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:56:02 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:56:02 user nova-compute[75734]:   <serial>609d12e6-0cdd-43b1-8917-f28605476935</serial>
Nov 22 15:56:02 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:56:02 user nova-compute[75734]: </disk>
Nov 22 15:56:02 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:56:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:56:03 user nova-compute[75734]: INFO nova.compute.claims [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Claim successful on node user
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:56:03 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.policy [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dc99ff4c7054545a10673afb2cf930b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234cf12714b74b12aa027c8fff2e784e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:56:03 user nova-compute[75734]: INFO nova.virt.block_device [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Booting with blank volume at /dev/vda
Nov 22 15:56:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-7d3210ff-059e-4443-aa3b-273c8aa41004 req-f7061074-f912-4e5e-b16c-375fca0b2894 service nova] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Received event network-vif-deleted-e4411fda-4320-4391-83d8-8b8f47250ed3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Successfully created port: f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:56:04 user nova-compute[75734]: INFO nova.compute.manager [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] [instance: 9e542b93-4c34-4101-ab33-f4dcf81ae00f] Took 2.63 seconds to detach 3 volumes for instance.
Nov 22 15:56:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Successfully updated port: f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:04 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:05 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Deleted allocations for instance 9e542b93-4c34-4101-ab33-f4dcf81ae00f
Nov 22 15:56:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating instance_info_cache with network_info: [{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance network_info: |[{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-618a97ef-aba8-4c0c-b8c1-b100fb03762e tempest-TaggedBootDevicesTest-157696607 tempest-TaggedBootDevicesTest-157696607-project-member] Lock "9e542b93-4c34-4101-ab33-f4dcf81ae00f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.128s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-changed-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Refreshing instance network info cache due to event network-changed-f2745d29-485b-4942-afe7-cbfe620d3938. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] Acquiring lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] Acquired lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Refreshing network info cache for port f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:56:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updated VIF entry in instance network info cache for port f2745d29-485b-4942-afe7-cbfe620d3938. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:56:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating instance_info_cache with network_info: [{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b3878a68-cd8d-48f1-af1d-37a3d7eccf52 req-a7676d64-344c-4b34-8330-b8951cdc2d8b service nova] Releasing lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:56:07 user nova-compute[75734]: INFO nova.compute.claims [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Claim successful on node user
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:56:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.policy [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3fc7f0844ed41488359c1dd43feeb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0495ec21f9b74a2e8d30e58d3ad504ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:56:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Creating image(s)
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "/opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "/opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk 1073741824" returned: 0 in 0.056s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Successfully created port: dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Cannot resize image /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Ensure instance console log exists: /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Successfully updated port: dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "refresh_cache-9fb1125f-ce45-4cb6-83a0-d90e92f2569a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquired lock "refresh_cache-9fb1125f-ce45-4cb6-83a0-d90e92f2569a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received event network-changed-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Refreshing instance network info cache due to event network-changed-dda26afc-be95-4012-8949-0133f58eecdc. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:56:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] Acquiring lock "refresh_cache-9fb1125f-ce45-4cb6-83a0-d90e92f2569a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Updating instance_info_cache with network_info: [{"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Releasing lock "refresh_cache-9fb1125f-ce45-4cb6-83a0-d90e92f2569a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Instance network_info: |[{"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] Acquired lock "refresh_cache-9fb1125f-ce45-4cb6-83a0-d90e92f2569a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Refreshing network info cache for port dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Start _get_guest_xml network_info=[{"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:56:09 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:56:09 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1351785811',display_name='tempest-VolumesAdminNegativeTest-server-1351785811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1351785811',id=12,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0495ec21f9b74a2e8d30e58d3ad504ff',ramdisk_id='',reservation_id='r-2cw8qen0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1651481107',owner_user_name='tempest-VolumesAdminNegativeTest-1651481107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:56:08Z,user_data=None,user_id='c3fc7f0844ed41488359c1dd43feeb66',uuid=9fb1125f-ce45-4cb6-83a0-d90e92f2569a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converting VIF {"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:4a:e2,bridge_name='br-int',has_traffic_filtering=True,id=dda26afc-be95-4012-8949-0133f58eecdc,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda26afc-be') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fb1125f-ce45-4cb6-83a0-d90e92f2569a {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:56:09 user nova-compute[75734]:   <uuid>9fb1125f-ce45-4cb6-83a0-d90e92f2569a</uuid>
Nov 22 15:56:09 user nova-compute[75734]:   <name>instance-0000000c</name>
Nov 22 15:56:09 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:56:09 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:56:09 user nova-compute[75734]:   <metadata>
Nov 22 15:56:09 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:56:09 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:56:09 user nova-compute[75734]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1351785811</nova:name>
Nov 22 15:56:09 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:56:09</nova:creationTime>
Nov 22 15:56:09 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:56:09 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:56:09 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:56:09 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:56:09 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:56:09 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:56:09 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:56:09 user nova-compute[75734]:       <nova:owner>
Nov 22 15:56:09 user nova-compute[75734]:         <nova:user uuid="c3fc7f0844ed41488359c1dd43feeb66">tempest-VolumesAdminNegativeTest-1651481107-project-member</nova:user>
Nov 22 15:56:09 user nova-compute[75734]:         <nova:project uuid="0495ec21f9b74a2e8d30e58d3ad504ff">tempest-VolumesAdminNegativeTest-1651481107</nova:project>
Nov 22 15:56:09 user nova-compute[75734]:       </nova:owner>
Nov 22 15:56:09 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:56:09 user nova-compute[75734]:       <nova:ports>
Nov 22 15:56:09 user nova-compute[75734]:         <nova:port uuid="dda26afc-be95-4012-8949-0133f58eecdc">
Nov 22 15:56:09 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 15:56:09 user nova-compute[75734]:         </nova:port>
Nov 22 15:56:09 user nova-compute[75734]:       </nova:ports>
Nov 22 15:56:09 user nova-compute[75734]:     </nova:instance>
Nov 22 15:56:09 user nova-compute[75734]:   </metadata>
Nov 22 15:56:09 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:56:09 user nova-compute[75734]:     <system>
Nov 22 15:56:09 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:56:09 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:56:09 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:56:09 user nova-compute[75734]:       <entry name="serial">9fb1125f-ce45-4cb6-83a0-d90e92f2569a</entry>
Nov 22 15:56:09 user nova-compute[75734]:       <entry name="uuid">9fb1125f-ce45-4cb6-83a0-d90e92f2569a</entry>
Nov 22 15:56:09 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:56:09 user nova-compute[75734]:     </system>
Nov 22 15:56:09 user nova-compute[75734]:   </sysinfo>
Nov 22 15:56:09 user nova-compute[75734]:   <os>
Nov 22 15:56:09 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:56:09 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:56:09 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:56:09 user nova-compute[75734]:   </os>
Nov 22 15:56:09 user nova-compute[75734]:   <features>
Nov 22 15:56:09 user nova-compute[75734]:     <acpi/>
Nov 22 15:56:09 user nova-compute[75734]:     <apic/>
Nov 22 15:56:09 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:56:09 user nova-compute[75734]:   </features>
Nov 22 15:56:09 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:56:09 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:56:09 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:56:09 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:56:09 user nova-compute[75734]:   </clock>
Nov 22 15:56:09 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:56:09 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:56:09 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:56:09 user nova-compute[75734]:   </cpu>
Nov 22 15:56:09 user nova-compute[75734]:   <devices>
Nov 22 15:56:09 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:56:09 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:56:09 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk"/>
Nov 22 15:56:09 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:56:09 user nova-compute[75734]:     </disk>
Nov 22 15:56:09 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:56:09 user nova-compute[75734]:       <mac address="fa:16:3e:ee:4a:e2"/>
Nov 22 15:56:09 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:56:09 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:56:09 user nova-compute[75734]:       <target dev="tapdda26afc-be"/>
Nov 22 15:56:09 user nova-compute[75734]:     </interface>
Nov 22 15:56:09 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:56:09 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/console.log" append="off"/>
Nov 22 15:56:09 user nova-compute[75734]:     </serial>
Nov 22 15:56:09 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:56:09 user nova-compute[75734]:     <video>
Nov 22 15:56:09 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:56:09 user nova-compute[75734]:     </video>
Nov 22 15:56:09 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:56:09 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:56:09 user nova-compute[75734]:     </rng>
Nov 22 15:56:09 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:56:09 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:56:09 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:56:09 user nova-compute[75734]:     </memballoon>
Nov 22 15:56:09 user nova-compute[75734]:   </devices>
Nov 22 15:56:09 user nova-compute[75734]: </domain>
Nov 22 15:56:09 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1351785811',display_name='tempest-VolumesAdminNegativeTest-server-1351785811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1351785811',id=12,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0495ec21f9b74a2e8d30e58d3ad504ff',ramdisk_id='',reservation_id='r-2cw8qen0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1651481107',owner_user_name='tempest-VolumesAdminNegativeTest-1651481107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:56:08Z,user_data=None,user_id='c3fc7f0844ed41488359c1dd43feeb66',uuid=9fb1125f-ce45-4cb6-83a0-d90e92f2569a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converting VIF {"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:4a:e2,bridge_name='br-int',has_traffic_filtering=True,id=dda26afc-be95-4012-8949-0133f58eecdc,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda26afc-be') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG os_vif [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:4a:e2,bridge_name='br-int',has_traffic_filtering=True,id=dda26afc-be95-4012-8949-0133f58eecdc,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda26afc-be') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe402f8b-5296-5498-a224-79e4d6c8309f', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdda26afc-be, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdda26afc-be, col_values=(('qos', UUID('aa6fecab-842e-4702-b6a7-7e611024e86d')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdda26afc-be, col_values=(('external_ids', {'iface-id': 'dda26afc-be95-4012-8949-0133f58eecdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:4a:e2', 'vm-uuid': '9fb1125f-ce45-4cb6-83a0-d90e92f2569a'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG os_brick.utils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:09 user nova-compute[75734]: INFO os_vif [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:4a:e2,bridge_name='br-int',has_traffic_filtering=True,id=dda26afc-be95-4012-8949-0133f58eecdc,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda26afc-be')
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcfa993-ea05-4d35-a07a-79ec0e25c818]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b2ef7-5a25-41bd-82dd-1e1af7a94fd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d0490b-3f94-4193-a584-275f68a416d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89acb3d-08b6-466f-a1fc-d03b31b4f316]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] No VIF found with MAC fa:16:3e:ee:4a:e2, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:56:09 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c130d82-04aa-4a54-bdb0-3f3eba43ca6a]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG os_brick.utils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating existing volume attachment record: a13e0219-26e3-4b1f-bd17-4621ae7a9cc9 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Updated VIF entry in instance network info cache for port dda26afc-be95-4012-8949-0133f58eecdc. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Updating instance_info_cache with network_info: [{"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4eddf8f6-e372-4151-aa75-88e7b3ca8ea4 req-32037335-5d78-4f72-82bc-b44ba4722c99 service nova] Releasing lock "refresh_cache-9fb1125f-ce45-4cb6-83a0-d90e92f2569a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-3c57fe8f-50db-40a7-9cc1-97e4e63cf6db req-39c2debf-65cb-4bd7-b105-402db2855963 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received event network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3c57fe8f-50db-40a7-9cc1-97e4e63cf6db req-39c2debf-65cb-4bd7-b105-402db2855963 service nova] Acquiring lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3c57fe8f-50db-40a7-9cc1-97e4e63cf6db req-39c2debf-65cb-4bd7-b105-402db2855963 service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3c57fe8f-50db-40a7-9cc1-97e4e63cf6db req-39c2debf-65cb-4bd7-b105-402db2855963 service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-3c57fe8f-50db-40a7-9cc1-97e4e63cf6db req-39c2debf-65cb-4bd7-b105-402db2855963 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] No waiting events found dispatching network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:11 user nova-compute[75734]: WARNING nova.compute.manager [req-3c57fe8f-50db-40a7-9cc1-97e4e63cf6db req-39c2debf-65cb-4bd7-b105-402db2855963 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received unexpected event network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc for instance with vm_state building and task_state spawning.
Nov 22 15:56:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:12 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Waiting for libvirt event about the detach of device tapcc127665-2c with device alias net1 from instance c158823f-476c-4691-9191-affa6e302565 is timed out.
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface> {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 22 15:56:12 user nova-compute[75734]:   <name>instance-00000006</name>
Nov 22 15:56:12 user nova-compute[75734]:   <uuid>c158823f-476c-4691-9191-affa6e302565</uuid>
Nov 22 15:56:12 user nova-compute[75734]:   <metadata>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:56:12 user nova-compute[75734]:   <nova:package version="0.0.0"/>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:creationTime>2023-11-22 15:55:13</nova:creationTime>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:flavor name="m1.tiny">
Nov 22 15:56:12 user nova-compute[75734]:     <nova:memory>512</nova:memory>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:disk>1</nova:disk>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:swap>0</nova:swap>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:vcpus>1</nova:vcpus>
Nov 22 15:56:12 user nova-compute[75734]:   </nova:flavor>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:owner>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:56:12 user nova-compute[75734]:   </nova:owner>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:ports>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:56:12 user nova-compute[75734]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:56:12 user nova-compute[75734]:     </nova:port>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:port uuid="cc127665-2c38-4d00-b78d-2e3d0634bc56">
Nov 22 15:56:12 user nova-compute[75734]:       <nova:ip type="fixed" address="10.10.10.164" ipVersion="4"/>
Nov 22 15:56:12 user nova-compute[75734]:     </nova:port>
Nov 22 15:56:12 user nova-compute[75734]:   </nova:ports>
Nov 22 15:56:12 user nova-compute[75734]: </nova:instance>
Nov 22 15:56:12 user nova-compute[75734]:   </metadata>
Nov 22 15:56:12 user nova-compute[75734]:   <memory unit='KiB'>524288</memory>
Nov 22 15:56:12 user nova-compute[75734]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 15:56:12 user nova-compute[75734]:   <vcpu placement='static'>1</vcpu>
Nov 22 15:56:12 user nova-compute[75734]:   <resource>
Nov 22 15:56:12 user nova-compute[75734]:     <partition>/machine</partition>
Nov 22 15:56:12 user nova-compute[75734]:   </resource>
Nov 22 15:56:12 user nova-compute[75734]:   <sysinfo type='smbios'>
Nov 22 15:56:12 user nova-compute[75734]:     <system>
Nov 22 15:56:12 user nova-compute[75734]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 15:56:12 user nova-compute[75734]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 15:56:12 user nova-compute[75734]:       <entry name='version'>0.0.0</entry>
Nov 22 15:56:12 user nova-compute[75734]:       <entry name='serial'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:56:12 user nova-compute[75734]:       <entry name='uuid'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:56:12 user nova-compute[75734]:       <entry name='family'>Virtual Machine</entry>
Nov 22 15:56:12 user nova-compute[75734]:     </system>
Nov 22 15:56:12 user nova-compute[75734]:   </sysinfo>
Nov 22 15:56:12 user nova-compute[75734]:   <os>
Nov 22 15:56:12 user nova-compute[75734]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 15:56:12 user nova-compute[75734]:     <boot dev='hd'/>
Nov 22 15:56:12 user nova-compute[75734]:     <smbios mode='sysinfo'/>
Nov 22 15:56:12 user nova-compute[75734]:   </os>
Nov 22 15:56:12 user nova-compute[75734]:   <features>
Nov 22 15:56:12 user nova-compute[75734]:     <acpi/>
Nov 22 15:56:12 user nova-compute[75734]:     <apic/>
Nov 22 15:56:12 user nova-compute[75734]:     <vmcoreinfo state='on'/>
Nov 22 15:56:12 user nova-compute[75734]:   </features>
Nov 22 15:56:12 user nova-compute[75734]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 15:56:12 user nova-compute[75734]:     <model fallback='forbid'>Nehalem</model>
Nov 22 15:56:12 user nova-compute[75734]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 15:56:12 user nova-compute[75734]:     <feature policy='require' name='vme'/>
Nov 22 15:56:12 user nova-compute[75734]:     <feature policy='require' name='x2apic'/>
Nov 22 15:56:12 user nova-compute[75734]:     <feature policy='require' name='hypervisor'/>
Nov 22 15:56:12 user nova-compute[75734]:   </cpu>
Nov 22 15:56:12 user nova-compute[75734]:   <clock offset='utc'>
Nov 22 15:56:12 user nova-compute[75734]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 15:56:12 user nova-compute[75734]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 15:56:12 user nova-compute[75734]:     <timer name='hpet' present='no'/>
Nov 22 15:56:12 user nova-compute[75734]:   </clock>
Nov 22 15:56:12 user nova-compute[75734]:   <on_poweroff>destroy</on_poweroff>
Nov 22 15:56:12 user nova-compute[75734]:   <on_reboot>restart</on_reboot>
Nov 22 15:56:12 user nova-compute[75734]:   <on_crash>destroy</on_crash>
Nov 22 15:56:12 user nova-compute[75734]:   <devices>
Nov 22 15:56:12 user nova-compute[75734]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 15:56:12 user nova-compute[75734]:     <disk type='file' device='disk'>
Nov 22 15:56:12 user nova-compute[75734]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 15:56:12 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk' index='2'/>
Nov 22 15:56:12 user nova-compute[75734]:       <backingStore type='file' index='3'>
Nov 22 15:56:12 user nova-compute[75734]:         <format type='raw'/>
Nov 22 15:56:12 user nova-compute[75734]:         <source file='/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544'/>
Nov 22 15:56:12 user nova-compute[75734]:         <backingStore/>
Nov 22 15:56:12 user nova-compute[75734]:       </backingStore>
Nov 22 15:56:12 user nova-compute[75734]:       <target dev='vda' bus='virtio'/>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='virtio-disk0'/>
Nov 22 15:56:12 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </disk>
Nov 22 15:56:12 user nova-compute[75734]:     <disk type='file' device='cdrom'>
Nov 22 15:56:12 user nova-compute[75734]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 15:56:12 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config' index='1'/>
Nov 22 15:56:12 user nova-compute[75734]:       <backingStore/>
Nov 22 15:56:12 user nova-compute[75734]:       <target dev='hda' bus='ide'/>
Nov 22 15:56:12 user nova-compute[75734]:       <readonly/>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='ide0-0-0'/>
Nov 22 15:56:12 user nova-compute[75734]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </disk>
Nov 22 15:56:12 user nova-compute[75734]:     <controller type='usb' index='0' model='none'>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='usb'/>
Nov 22 15:56:12 user nova-compute[75734]:     </controller>
Nov 22 15:56:12 user nova-compute[75734]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='pci.0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </controller>
Nov 22 15:56:12 user nova-compute[75734]:     <controller type='ide' index='0'>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='ide'/>
Nov 22 15:56:12 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 15:56:12 user nova-compute[75734]:     </controller>
Nov 22 15:56:12 user nova-compute[75734]:     <interface type='ethernet'>
Nov 22 15:56:12 user nova-compute[75734]:       <mac address='fa:16:3e:0f:10:66'/>
Nov 22 15:56:12 user nova-compute[75734]:       <target dev='tap22d78f0a-27'/>
Nov 22 15:56:12 user nova-compute[75734]:       <model type='virtio'/>
Nov 22 15:56:12 user nova-compute[75734]:       <mtu size='1442'/>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='net0'/>
Nov 22 15:56:12 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </interface>
Nov 22 15:56:12 user nova-compute[75734]:     <serial type='pty'>
Nov 22 15:56:12 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:56:12 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:56:12 user nova-compute[75734]:       <target type='isa-serial' port='0'>
Nov 22 15:56:12 user nova-compute[75734]:         <model name='isa-serial'/>
Nov 22 15:56:12 user nova-compute[75734]:       </target>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </serial>
Nov 22 15:56:12 user nova-compute[75734]:     <console type='pty' tty='/dev/pts/5'>
Nov 22 15:56:12 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:56:12 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:56:12 user nova-compute[75734]:       <target type='serial' port='0'/>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </console>
Nov 22 15:56:12 user nova-compute[75734]:     <input type='mouse' bus='ps2'>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='input0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </input>
Nov 22 15:56:12 user nova-compute[75734]:     <input type='keyboard' bus='ps2'>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='input1'/>
Nov 22 15:56:12 user nova-compute[75734]:     </input>
Nov 22 15:56:12 user nova-compute[75734]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 22 15:56:12 user nova-compute[75734]:       <listen type='address' address='0.0.0.0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </graphics>
Nov 22 15:56:12 user nova-compute[75734]:     <audio id='1' type='none'/>
Nov 22 15:56:12 user nova-compute[75734]:     <video>
Nov 22 15:56:12 user nova-compute[75734]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='video0'/>
Nov 22 15:56:12 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </video>
Nov 22 15:56:12 user nova-compute[75734]:     <memballoon model='virtio'>
Nov 22 15:56:12 user nova-compute[75734]:       <stats period='10'/>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='balloon0'/>
Nov 22 15:56:12 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </memballoon>
Nov 22 15:56:12 user nova-compute[75734]:     <rng model='virtio'>
Nov 22 15:56:12 user nova-compute[75734]:       <backend model='random'>/dev/urandom</backend>
Nov 22 15:56:12 user nova-compute[75734]:       <alias name='rng0'/>
Nov 22 15:56:12 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 15:56:12 user nova-compute[75734]:     </rng>
Nov 22 15:56:12 user nova-compute[75734]:   </devices>
Nov 22 15:56:12 user nova-compute[75734]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 15:56:12 user nova-compute[75734]:     <label>libvirt-c158823f-476c-4691-9191-affa6e302565</label>
Nov 22 15:56:12 user nova-compute[75734]:     <imagelabel>libvirt-c158823f-476c-4691-9191-affa6e302565</imagelabel>
Nov 22 15:56:12 user nova-compute[75734]:   </seclabel>
Nov 22 15:56:12 user nova-compute[75734]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 15:56:12 user nova-compute[75734]:     <label>+64055:+108</label>
Nov 22 15:56:12 user nova-compute[75734]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 15:56:12 user nova-compute[75734]:   </seclabel>
Nov 22 15:56:12 user nova-compute[75734]: </domain>
Nov 22 15:56:12 user nova-compute[75734]:  {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 15:56:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully detached device tapcc127665-2c from instance c158823f-476c-4691-9191-affa6e302565 from the live domain config.
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converting VIF {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG os_vif [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc127665-2c, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd258b1e-b840-464f-a043-2450b80f0d29) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:12 user nova-compute[75734]: INFO os_vif [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c')
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:56:12 user nova-compute[75734]:   <nova:package version="0.0.0"/>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:creationTime>2023-11-22 15:56:12</nova:creationTime>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:flavor name="m1.tiny">
Nov 22 15:56:12 user nova-compute[75734]:     <nova:memory>512</nova:memory>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:disk>1</nova:disk>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:swap>0</nova:swap>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:vcpus>1</nova:vcpus>
Nov 22 15:56:12 user nova-compute[75734]:   </nova:flavor>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:owner>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:56:12 user nova-compute[75734]:   </nova:owner>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:56:12 user nova-compute[75734]:   <nova:ports>
Nov 22 15:56:12 user nova-compute[75734]:     <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:56:12 user nova-compute[75734]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:56:12 user nova-compute[75734]:     </nova:port>
Nov 22 15:56:12 user nova-compute[75734]:   </nova:ports>
Nov 22 15:56:12 user nova-compute[75734]: </nova:instance>
Nov 22 15:56:12 user nova-compute[75734]:  {{(pid=75734) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:56:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Instance spawned successfully.
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:13 user nova-compute[75734]: INFO nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8af631d-46dc-4a69-a993-687971dcb2cf req-e88b2d6f-635f-43d4-915c-556b76888b60 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received event network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8af631d-46dc-4a69-a993-687971dcb2cf req-e88b2d6f-635f-43d4-915c-556b76888b60 service nova] Acquiring lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8af631d-46dc-4a69-a993-687971dcb2cf req-e88b2d6f-635f-43d4-915c-556b76888b60 service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8af631d-46dc-4a69-a993-687971dcb2cf req-e88b2d6f-635f-43d4-915c-556b76888b60 service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8af631d-46dc-4a69-a993-687971dcb2cf req-e88b2d6f-635f-43d4-915c-556b76888b60 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] No waiting events found dispatching network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:13 user nova-compute[75734]: WARNING nova.compute.manager [req-f8af631d-46dc-4a69-a993-687971dcb2cf req-e88b2d6f-635f-43d4-915c-556b76888b60 service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received unexpected event network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc for instance with vm_state building and task_state spawning.
Nov 22 15:56:13 user nova-compute[75734]: INFO nova.compute.manager [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Took 6.07 seconds to build instance.
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1315237f-b671-4797-ab63-dce6271f0b3b tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.171s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-deleted-cc127665-2c38-4d00-b78d-2e3d0634bc56 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:13 user nova-compute[75734]: INFO nova.compute.manager [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Neutron deleted interface cc127665-2c38-4d00-b78d-2e3d0634bc56; detaching it from the instance and deleting it from the info cache
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquired lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.objects.instance [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Lazy-loading 'system_metadata' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.objects.instance [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Lazy-loading 'flavor' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.objects.base [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Object Instance<c158823f-476c-4691-9191-affa6e302565> lazy-loaded attributes: system_metadata,flavor {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Converting VIF {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface> {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 22 15:56:13 user nova-compute[75734]:   <name>instance-00000006</name>
Nov 22 15:56:13 user nova-compute[75734]:   <uuid>c158823f-476c-4691-9191-affa6e302565</uuid>
Nov 22 15:56:13 user nova-compute[75734]:   <metadata>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:56:13 user nova-compute[75734]:   <nova:package version="0.0.0"/>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:creationTime>2023-11-22 15:56:12</nova:creationTime>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:flavor name="m1.tiny">
Nov 22 15:56:13 user nova-compute[75734]:     <nova:memory>512</nova:memory>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:disk>1</nova:disk>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:swap>0</nova:swap>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:vcpus>1</nova:vcpus>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:flavor>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:owner>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:owner>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:ports>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:56:13 user nova-compute[75734]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:56:13 user nova-compute[75734]:     </nova:port>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:ports>
Nov 22 15:56:13 user nova-compute[75734]: </nova:instance>
Nov 22 15:56:13 user nova-compute[75734]:   </metadata>
Nov 22 15:56:13 user nova-compute[75734]:   <memory unit='KiB'>524288</memory>
Nov 22 15:56:13 user nova-compute[75734]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 15:56:13 user nova-compute[75734]:   <vcpu placement='static'>1</vcpu>
Nov 22 15:56:13 user nova-compute[75734]:   <resource>
Nov 22 15:56:13 user nova-compute[75734]:     <partition>/machine</partition>
Nov 22 15:56:13 user nova-compute[75734]:   </resource>
Nov 22 15:56:13 user nova-compute[75734]:   <sysinfo type='smbios'>
Nov 22 15:56:13 user nova-compute[75734]:     <system>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='version'>0.0.0</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='serial'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='uuid'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='family'>Virtual Machine</entry>
Nov 22 15:56:13 user nova-compute[75734]:     </system>
Nov 22 15:56:13 user nova-compute[75734]:   </sysinfo>
Nov 22 15:56:13 user nova-compute[75734]:   <os>
Nov 22 15:56:13 user nova-compute[75734]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 15:56:13 user nova-compute[75734]:     <boot dev='hd'/>
Nov 22 15:56:13 user nova-compute[75734]:     <smbios mode='sysinfo'/>
Nov 22 15:56:13 user nova-compute[75734]:   </os>
Nov 22 15:56:13 user nova-compute[75734]:   <features>
Nov 22 15:56:13 user nova-compute[75734]:     <acpi/>
Nov 22 15:56:13 user nova-compute[75734]:     <apic/>
Nov 22 15:56:13 user nova-compute[75734]:     <vmcoreinfo state='on'/>
Nov 22 15:56:13 user nova-compute[75734]:   </features>
Nov 22 15:56:13 user nova-compute[75734]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 15:56:13 user nova-compute[75734]:     <model fallback='forbid'>Nehalem</model>
Nov 22 15:56:13 user nova-compute[75734]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 15:56:13 user nova-compute[75734]:     <feature policy='require' name='vme'/>
Nov 22 15:56:13 user nova-compute[75734]:     <feature policy='require' name='x2apic'/>
Nov 22 15:56:13 user nova-compute[75734]:     <feature policy='require' name='hypervisor'/>
Nov 22 15:56:13 user nova-compute[75734]:   </cpu>
Nov 22 15:56:13 user nova-compute[75734]:   <clock offset='utc'>
Nov 22 15:56:13 user nova-compute[75734]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 15:56:13 user nova-compute[75734]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 15:56:13 user nova-compute[75734]:     <timer name='hpet' present='no'/>
Nov 22 15:56:13 user nova-compute[75734]:   </clock>
Nov 22 15:56:13 user nova-compute[75734]:   <on_poweroff>destroy</on_poweroff>
Nov 22 15:56:13 user nova-compute[75734]:   <on_reboot>restart</on_reboot>
Nov 22 15:56:13 user nova-compute[75734]:   <on_crash>destroy</on_crash>
Nov 22 15:56:13 user nova-compute[75734]:   <devices>
Nov 22 15:56:13 user nova-compute[75734]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 15:56:13 user nova-compute[75734]:     <disk type='file' device='disk'>
Nov 22 15:56:13 user nova-compute[75734]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 15:56:13 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk' index='2'/>
Nov 22 15:56:13 user nova-compute[75734]:       <backingStore type='file' index='3'>
Nov 22 15:56:13 user nova-compute[75734]:         <format type='raw'/>
Nov 22 15:56:13 user nova-compute[75734]:         <source file='/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544'/>
Nov 22 15:56:13 user nova-compute[75734]:         <backingStore/>
Nov 22 15:56:13 user nova-compute[75734]:       </backingStore>
Nov 22 15:56:13 user nova-compute[75734]:       <target dev='vda' bus='virtio'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='virtio-disk0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </disk>
Nov 22 15:56:13 user nova-compute[75734]:     <disk type='file' device='cdrom'>
Nov 22 15:56:13 user nova-compute[75734]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 15:56:13 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config' index='1'/>
Nov 22 15:56:13 user nova-compute[75734]:       <backingStore/>
Nov 22 15:56:13 user nova-compute[75734]:       <target dev='hda' bus='ide'/>
Nov 22 15:56:13 user nova-compute[75734]:       <readonly/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='ide0-0-0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </disk>
Nov 22 15:56:13 user nova-compute[75734]:     <controller type='usb' index='0' model='none'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='usb'/>
Nov 22 15:56:13 user nova-compute[75734]:     </controller>
Nov 22 15:56:13 user nova-compute[75734]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='pci.0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </controller>
Nov 22 15:56:13 user nova-compute[75734]:     <controller type='ide' index='0'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='ide'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 15:56:13 user nova-compute[75734]:     </controller>
Nov 22 15:56:13 user nova-compute[75734]:     <interface type='ethernet'>
Nov 22 15:56:13 user nova-compute[75734]:       <mac address='fa:16:3e:0f:10:66'/>
Nov 22 15:56:13 user nova-compute[75734]:       <target dev='tap22d78f0a-27'/>
Nov 22 15:56:13 user nova-compute[75734]:       <model type='virtio'/>
Nov 22 15:56:13 user nova-compute[75734]:       <mtu size='1442'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='net0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </interface>
Nov 22 15:56:13 user nova-compute[75734]:     <serial type='pty'>
Nov 22 15:56:13 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:56:13 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:56:13 user nova-compute[75734]:       <target type='isa-serial' port='0'>
Nov 22 15:56:13 user nova-compute[75734]:         <model name='isa-serial'/>
Nov 22 15:56:13 user nova-compute[75734]:       </target>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </serial>
Nov 22 15:56:13 user nova-compute[75734]:     <console type='pty' tty='/dev/pts/5'>
Nov 22 15:56:13 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:56:13 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:56:13 user nova-compute[75734]:       <target type='serial' port='0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </console>
Nov 22 15:56:13 user nova-compute[75734]:     <input type='mouse' bus='ps2'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='input0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </input>
Nov 22 15:56:13 user nova-compute[75734]:     <input type='keyboard' bus='ps2'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='input1'/>
Nov 22 15:56:13 user nova-compute[75734]:     </input>
Nov 22 15:56:13 user nova-compute[75734]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 22 15:56:13 user nova-compute[75734]:       <listen type='address' address='0.0.0.0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </graphics>
Nov 22 15:56:13 user nova-compute[75734]:     <audio id='1' type='none'/>
Nov 22 15:56:13 user nova-compute[75734]:     <video>
Nov 22 15:56:13 user nova-compute[75734]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='video0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </video>
Nov 22 15:56:13 user nova-compute[75734]:     <memballoon model='virtio'>
Nov 22 15:56:13 user nova-compute[75734]:       <stats period='10'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='balloon0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </memballoon>
Nov 22 15:56:13 user nova-compute[75734]:     <rng model='virtio'>
Nov 22 15:56:13 user nova-compute[75734]:       <backend model='random'>/dev/urandom</backend>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='rng0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </rng>
Nov 22 15:56:13 user nova-compute[75734]:   </devices>
Nov 22 15:56:13 user nova-compute[75734]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 15:56:13 user nova-compute[75734]:     <label>libvirt-c158823f-476c-4691-9191-affa6e302565</label>
Nov 22 15:56:13 user nova-compute[75734]:     <imagelabel>libvirt-c158823f-476c-4691-9191-affa6e302565</imagelabel>
Nov 22 15:56:13 user nova-compute[75734]:   </seclabel>
Nov 22 15:56:13 user nova-compute[75734]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 15:56:13 user nova-compute[75734]:     <label>+64055:+108</label>
Nov 22 15:56:13 user nova-compute[75734]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 15:56:13 user nova-compute[75734]:   </seclabel>
Nov 22 15:56:13 user nova-compute[75734]: </domain>
Nov 22 15:56:13 user nova-compute[75734]:  {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface> {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0d:e4:79"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc127665-2c"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 22 15:56:13 user nova-compute[75734]:   <name>instance-00000006</name>
Nov 22 15:56:13 user nova-compute[75734]:   <uuid>c158823f-476c-4691-9191-affa6e302565</uuid>
Nov 22 15:56:13 user nova-compute[75734]:   <metadata>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:56:13 user nova-compute[75734]:   <nova:package version="0.0.0"/>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:creationTime>2023-11-22 15:56:12</nova:creationTime>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:flavor name="m1.tiny">
Nov 22 15:56:13 user nova-compute[75734]:     <nova:memory>512</nova:memory>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:disk>1</nova:disk>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:swap>0</nova:swap>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:vcpus>1</nova:vcpus>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:flavor>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:owner>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:owner>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:ports>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:56:13 user nova-compute[75734]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:56:13 user nova-compute[75734]:     </nova:port>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:ports>
Nov 22 15:56:13 user nova-compute[75734]: </nova:instance>
Nov 22 15:56:13 user nova-compute[75734]:   </metadata>
Nov 22 15:56:13 user nova-compute[75734]:   <memory unit='KiB'>524288</memory>
Nov 22 15:56:13 user nova-compute[75734]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 15:56:13 user nova-compute[75734]:   <vcpu placement='static'>1</vcpu>
Nov 22 15:56:13 user nova-compute[75734]:   <resource>
Nov 22 15:56:13 user nova-compute[75734]:     <partition>/machine</partition>
Nov 22 15:56:13 user nova-compute[75734]:   </resource>
Nov 22 15:56:13 user nova-compute[75734]:   <sysinfo type='smbios'>
Nov 22 15:56:13 user nova-compute[75734]:     <system>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='version'>0.0.0</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='serial'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='uuid'>c158823f-476c-4691-9191-affa6e302565</entry>
Nov 22 15:56:13 user nova-compute[75734]:       <entry name='family'>Virtual Machine</entry>
Nov 22 15:56:13 user nova-compute[75734]:     </system>
Nov 22 15:56:13 user nova-compute[75734]:   </sysinfo>
Nov 22 15:56:13 user nova-compute[75734]:   <os>
Nov 22 15:56:13 user nova-compute[75734]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 15:56:13 user nova-compute[75734]:     <boot dev='hd'/>
Nov 22 15:56:13 user nova-compute[75734]:     <smbios mode='sysinfo'/>
Nov 22 15:56:13 user nova-compute[75734]:   </os>
Nov 22 15:56:13 user nova-compute[75734]:   <features>
Nov 22 15:56:13 user nova-compute[75734]:     <acpi/>
Nov 22 15:56:13 user nova-compute[75734]:     <apic/>
Nov 22 15:56:13 user nova-compute[75734]:     <vmcoreinfo state='on'/>
Nov 22 15:56:13 user nova-compute[75734]:   </features>
Nov 22 15:56:13 user nova-compute[75734]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 15:56:13 user nova-compute[75734]:     <model fallback='forbid'>Nehalem</model>
Nov 22 15:56:13 user nova-compute[75734]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 15:56:13 user nova-compute[75734]:     <feature policy='require' name='vme'/>
Nov 22 15:56:13 user nova-compute[75734]:     <feature policy='require' name='x2apic'/>
Nov 22 15:56:13 user nova-compute[75734]:     <feature policy='require' name='hypervisor'/>
Nov 22 15:56:13 user nova-compute[75734]:   </cpu>
Nov 22 15:56:13 user nova-compute[75734]:   <clock offset='utc'>
Nov 22 15:56:13 user nova-compute[75734]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 15:56:13 user nova-compute[75734]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 15:56:13 user nova-compute[75734]:     <timer name='hpet' present='no'/>
Nov 22 15:56:13 user nova-compute[75734]:   </clock>
Nov 22 15:56:13 user nova-compute[75734]:   <on_poweroff>destroy</on_poweroff>
Nov 22 15:56:13 user nova-compute[75734]:   <on_reboot>restart</on_reboot>
Nov 22 15:56:13 user nova-compute[75734]:   <on_crash>destroy</on_crash>
Nov 22 15:56:13 user nova-compute[75734]:   <devices>
Nov 22 15:56:13 user nova-compute[75734]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 15:56:13 user nova-compute[75734]:     <disk type='file' device='disk'>
Nov 22 15:56:13 user nova-compute[75734]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 15:56:13 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk' index='2'/>
Nov 22 15:56:13 user nova-compute[75734]:       <backingStore type='file' index='3'>
Nov 22 15:56:13 user nova-compute[75734]:         <format type='raw'/>
Nov 22 15:56:13 user nova-compute[75734]:         <source file='/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544'/>
Nov 22 15:56:13 user nova-compute[75734]:         <backingStore/>
Nov 22 15:56:13 user nova-compute[75734]:       </backingStore>
Nov 22 15:56:13 user nova-compute[75734]:       <target dev='vda' bus='virtio'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='virtio-disk0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </disk>
Nov 22 15:56:13 user nova-compute[75734]:     <disk type='file' device='cdrom'>
Nov 22 15:56:13 user nova-compute[75734]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 15:56:13 user nova-compute[75734]:       <source file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/disk.config' index='1'/>
Nov 22 15:56:13 user nova-compute[75734]:       <backingStore/>
Nov 22 15:56:13 user nova-compute[75734]:       <target dev='hda' bus='ide'/>
Nov 22 15:56:13 user nova-compute[75734]:       <readonly/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='ide0-0-0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </disk>
Nov 22 15:56:13 user nova-compute[75734]:     <controller type='usb' index='0' model='none'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='usb'/>
Nov 22 15:56:13 user nova-compute[75734]:     </controller>
Nov 22 15:56:13 user nova-compute[75734]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='pci.0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </controller>
Nov 22 15:56:13 user nova-compute[75734]:     <controller type='ide' index='0'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='ide'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 15:56:13 user nova-compute[75734]:     </controller>
Nov 22 15:56:13 user nova-compute[75734]:     <interface type='ethernet'>
Nov 22 15:56:13 user nova-compute[75734]:       <mac address='fa:16:3e:0f:10:66'/>
Nov 22 15:56:13 user nova-compute[75734]:       <target dev='tap22d78f0a-27'/>
Nov 22 15:56:13 user nova-compute[75734]:       <model type='virtio'/>
Nov 22 15:56:13 user nova-compute[75734]:       <mtu size='1442'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='net0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </interface>
Nov 22 15:56:13 user nova-compute[75734]:     <serial type='pty'>
Nov 22 15:56:13 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:56:13 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:56:13 user nova-compute[75734]:       <target type='isa-serial' port='0'>
Nov 22 15:56:13 user nova-compute[75734]:         <model name='isa-serial'/>
Nov 22 15:56:13 user nova-compute[75734]:       </target>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </serial>
Nov 22 15:56:13 user nova-compute[75734]:     <console type='pty' tty='/dev/pts/5'>
Nov 22 15:56:13 user nova-compute[75734]:       <source path='/dev/pts/5'/>
Nov 22 15:56:13 user nova-compute[75734]:       <log file='/opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565/console.log' append='off'/>
Nov 22 15:56:13 user nova-compute[75734]:       <target type='serial' port='0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='serial0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </console>
Nov 22 15:56:13 user nova-compute[75734]:     <input type='mouse' bus='ps2'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='input0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </input>
Nov 22 15:56:13 user nova-compute[75734]:     <input type='keyboard' bus='ps2'>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='input1'/>
Nov 22 15:56:13 user nova-compute[75734]:     </input>
Nov 22 15:56:13 user nova-compute[75734]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 22 15:56:13 user nova-compute[75734]:       <listen type='address' address='0.0.0.0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </graphics>
Nov 22 15:56:13 user nova-compute[75734]:     <audio id='1' type='none'/>
Nov 22 15:56:13 user nova-compute[75734]:     <video>
Nov 22 15:56:13 user nova-compute[75734]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='video0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </video>
Nov 22 15:56:13 user nova-compute[75734]:     <memballoon model='virtio'>
Nov 22 15:56:13 user nova-compute[75734]:       <stats period='10'/>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='balloon0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </memballoon>
Nov 22 15:56:13 user nova-compute[75734]:     <rng model='virtio'>
Nov 22 15:56:13 user nova-compute[75734]:       <backend model='random'>/dev/urandom</backend>
Nov 22 15:56:13 user nova-compute[75734]:       <alias name='rng0'/>
Nov 22 15:56:13 user nova-compute[75734]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 15:56:13 user nova-compute[75734]:     </rng>
Nov 22 15:56:13 user nova-compute[75734]:   </devices>
Nov 22 15:56:13 user nova-compute[75734]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 15:56:13 user nova-compute[75734]:     <label>libvirt-c158823f-476c-4691-9191-affa6e302565</label>
Nov 22 15:56:13 user nova-compute[75734]:     <imagelabel>libvirt-c158823f-476c-4691-9191-affa6e302565</imagelabel>
Nov 22 15:56:13 user nova-compute[75734]:   </seclabel>
Nov 22 15:56:13 user nova-compute[75734]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 15:56:13 user nova-compute[75734]:     <label>+64055:+108</label>
Nov 22 15:56:13 user nova-compute[75734]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 15:56:13 user nova-compute[75734]:   </seclabel>
Nov 22 15:56:13 user nova-compute[75734]: </domain>
Nov 22 15:56:13 user nova-compute[75734]:  {{(pid=75734) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 15:56:13 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Detaching interface fa:16:3e:0d:e4:79 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapcc127665-2c' not found.
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Converting VIF {"id": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "address": "fa:16:3e:0d:e4:79", "network": {"id": "c1ca0039-6e06-495c-bc2e-e46faec7836f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712761494", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc127665-2c", "ovs_interfaceid": "cc127665-2c38-4d00-b78d-2e3d0634bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG os_vif [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc127665-2c, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:56:13 user nova-compute[75734]: INFO os_vif [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:79,bridge_name='br-int',has_traffic_filtering=True,id=cc127665-2c38-4d00-b78d-2e3d0634bc56,network=Network(c1ca0039-6e06-495c-bc2e-e46faec7836f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc127665-2c')
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [req-32cfd009-cadf-4010-b320-1cad8f4a3aa8 req-b603fd05-e3c1-4350-9d18-916a5cc02d33 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:56:13 user nova-compute[75734]:   <nova:package version="0.0.0"/>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:name>tempest-device-tagging-server-942617789</nova:name>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:creationTime>2023-11-22 15:56:13</nova:creationTime>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:flavor name="m1.tiny">
Nov 22 15:56:13 user nova-compute[75734]:     <nova:memory>512</nova:memory>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:disk>1</nova:disk>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:swap>0</nova:swap>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:vcpus>1</nova:vcpus>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:flavor>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:owner>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:user uuid="5ae04e9a5bfa4c4088140b509e449832">tempest-TaggedAttachmentsTest-49264513-project-member</nova:user>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:project uuid="0e08ca1d63bf409ba53a06635e0fdb27">tempest-TaggedAttachmentsTest-49264513</nova:project>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:owner>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:56:13 user nova-compute[75734]:   <nova:ports>
Nov 22 15:56:13 user nova-compute[75734]:     <nova:port uuid="22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5">
Nov 22 15:56:13 user nova-compute[75734]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:56:13 user nova-compute[75734]:     </nova:port>
Nov 22 15:56:13 user nova-compute[75734]:   </nova:ports>
Nov 22 15:56:13 user nova-compute[75734]: </nova:instance>
Nov 22 15:56:13 user nova-compute[75734]:  {{(pid=75734) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [{"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Releasing lock "refresh_cache-c158823f-476c-4691-9191-affa6e302565" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d64fb77-1295-47ed-9d33-c46bbc9bd6ad tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "interface-c158823f-476c-4691-9191-affa6e302565-cc127665-2c38-4d00-b78d-2e3d0634bc56" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.575s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-changed-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Refreshing instance network info cache due to event network-changed-4de00436-a2b1-4725-bb63-35109e31d750. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:56:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] Acquiring lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] Acquired lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:14 user nova-compute[75734]: DEBUG nova.network.neutron [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Refreshing network info cache for port 4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updated VIF entry in instance network info cache for port 4de00436-a2b1-4725-bb63-35109e31d750. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updating instance_info_cache with network_info: [{"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2eab3ec2-b115-4a8b-9c39-8851ff46580a req-f38d551b-2ad6-422a-a65f-97dbd33188aa service nova] Releasing lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG nova.objects.instance [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'flavor' on Instance uuid 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:15 user nova-compute[75734]: INFO nova.compute.manager [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Attaching volume 8640cd0b-2737-44e0-a754-9e95ccf798db to /dev/vdb
Nov 22 15:56:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG os_brick.utils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c65f5ae-fe2a-4ea5-8ad7-255d452c064b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6837f24b-06b4-45c3-997b-f0922b69634b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9f13a-14a1-400a-b27d-789f9ccac8ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f23f08a-f58a-4182-820f-f50b203e654a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:56:15 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:56:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f3af7a-73f1-4346-ad39-a4583b1c057e]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG os_brick.utils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:15 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updating existing volume attachment record: bbda2a28-5d05-4970-8c05-b05cfabf38e2 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:56:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Creating image(s)
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Ensure instance console log exists: /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Start _get_guest_xml network_info=[{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a13e0219-26e3-4b1f-bd17-4621ae7a9cc9', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNtumXRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '635ef0b9-e96c-4d0d-8f62-4382ad2813b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0823898-f136-4505-8853-c6cb928e2ecf', 'serial': 'b0823898-f136-4505-8853-c6cb928e2ecf'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:56:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:56:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNtumXRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:17 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:17 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:17 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9960974f-2ada-4b39-8123-449e35cb7568]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:56:17 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003ea2a-567b-4aa6-ab58-93b2cd9e0a36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf] added
Nov 22 15:56:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d80d3f-d395-48fe-aaa9-1658a5f7eef3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8469602-ae69-4cac-b7f0-0e0b2fd82e7d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNtumXRZ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNtumXRZ" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7396b434-0207-4b1c-9fdb-c76d50542dc1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNtumXRZ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a32ebe-441e-401a-b733-e86f1217564b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72f7f89-e711-4bfb-b8b0-90faeb1df4df]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bddd7cb-96e2-472e-87fb-53c172b6fb9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260]
Nov 22 15:56:17 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93631e8-4eb4-4297-9fac-960e15aac609]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1538d4-f892-4ddd-a1f5-6eff2d8d32e4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c196b56f-49dc-4121-a69d-bfeb72df7526]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:56:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNtumXRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26266386531353234', 'path': '/dev/sdd'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266386531353234', 'path': '/dev/sdd'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-625597841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-625597841',id=11,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-1zztwyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:56:04Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=635ef0b9-e96c-4d0d-8f62-4382ad2813b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.objects.instance [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'pci_devices' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:56:18 user nova-compute[75734]:   <uuid>635ef0b9-e96c-4d0d-8f62-4382ad2813b8</uuid>
Nov 22 15:56:18 user nova-compute[75734]:   <name>instance-0000000b</name>
Nov 22 15:56:18 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:56:18 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:56:18 user nova-compute[75734]:   <metadata>
Nov 22 15:56:18 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:56:18 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:56:18 user nova-compute[75734]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-625597841</nova:name>
Nov 22 15:56:18 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:56:17</nova:creationTime>
Nov 22 15:56:18 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:56:18 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:56:18 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:56:18 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:56:18 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:56:18 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:56:18 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:56:18 user nova-compute[75734]:       <nova:owner>
Nov 22 15:56:18 user nova-compute[75734]:         <nova:user uuid="5dc99ff4c7054545a10673afb2cf930b">tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member</nova:user>
Nov 22 15:56:18 user nova-compute[75734]:         <nova:project uuid="234cf12714b74b12aa027c8fff2e784e">tempest-ServerBootFromVolumeStableRescueTest-1333150873</nova:project>
Nov 22 15:56:18 user nova-compute[75734]:       </nova:owner>
Nov 22 15:56:18 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:56:18 user nova-compute[75734]:       <nova:ports>
Nov 22 15:56:18 user nova-compute[75734]:         <nova:port uuid="f2745d29-485b-4942-afe7-cbfe620d3938">
Nov 22 15:56:18 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 15:56:18 user nova-compute[75734]:         </nova:port>
Nov 22 15:56:18 user nova-compute[75734]:       </nova:ports>
Nov 22 15:56:18 user nova-compute[75734]:     </nova:instance>
Nov 22 15:56:18 user nova-compute[75734]:   </metadata>
Nov 22 15:56:18 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:56:18 user nova-compute[75734]:     <system>
Nov 22 15:56:18 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:56:18 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:56:18 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:56:18 user nova-compute[75734]:       <entry name="serial">635ef0b9-e96c-4d0d-8f62-4382ad2813b8</entry>
Nov 22 15:56:18 user nova-compute[75734]:       <entry name="uuid">635ef0b9-e96c-4d0d-8f62-4382ad2813b8</entry>
Nov 22 15:56:18 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:56:18 user nova-compute[75734]:     </system>
Nov 22 15:56:18 user nova-compute[75734]:   </sysinfo>
Nov 22 15:56:18 user nova-compute[75734]:   <os>
Nov 22 15:56:18 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:56:18 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:56:18 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:56:18 user nova-compute[75734]:   </os>
Nov 22 15:56:18 user nova-compute[75734]:   <features>
Nov 22 15:56:18 user nova-compute[75734]:     <acpi/>
Nov 22 15:56:18 user nova-compute[75734]:     <apic/>
Nov 22 15:56:18 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:56:18 user nova-compute[75734]:   </features>
Nov 22 15:56:18 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:56:18 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:56:18 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:56:18 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:56:18 user nova-compute[75734]:   </clock>
Nov 22 15:56:18 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:56:18 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:56:18 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:56:18 user nova-compute[75734]:   </cpu>
Nov 22 15:56:18 user nova-compute[75734]:   <devices>
Nov 22 15:56:18 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:56:18 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:56:18 user nova-compute[75734]:       <source dev="/dev/sdd"/>
Nov 22 15:56:18 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:56:18 user nova-compute[75734]:       <serial>b0823898-f136-4505-8853-c6cb928e2ecf</serial>
Nov 22 15:56:18 user nova-compute[75734]:     </disk>
Nov 22 15:56:18 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:56:18 user nova-compute[75734]:       <mac address="fa:16:3e:30:76:b0"/>
Nov 22 15:56:18 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:56:18 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:56:18 user nova-compute[75734]:       <target dev="tapf2745d29-48"/>
Nov 22 15:56:18 user nova-compute[75734]:     </interface>
Nov 22 15:56:18 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:56:18 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/console.log" append="off"/>
Nov 22 15:56:18 user nova-compute[75734]:     </serial>
Nov 22 15:56:18 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:56:18 user nova-compute[75734]:     <video>
Nov 22 15:56:18 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:56:18 user nova-compute[75734]:     </video>
Nov 22 15:56:18 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:56:18 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:56:18 user nova-compute[75734]:     </rng>
Nov 22 15:56:18 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:56:18 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:56:18 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:56:18 user nova-compute[75734]:     </memballoon>
Nov 22 15:56:18 user nova-compute[75734]:   </devices>
Nov 22 15:56:18 user nova-compute[75734]: </domain>
Nov 22 15:56:18 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-625597841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-625597841',id=11,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-1zztwyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:56:04Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=635ef0b9-e96c-4d0d-8f62-4382ad2813b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG os_vif [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05c47309-4c08-5cc4-aa72-1bb9720ef2bd', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2745d29-48, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2745d29-48, col_values=(('qos', UUID('15511b2d-c9ad-4014-9cfe-79deaceebba0')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2745d29-48, col_values=(('external_ids', {'iface-id': 'f2745d29-485b-4942-afe7-cbfe620d3938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:76:b0', 'vm-uuid': '635ef0b9-e96c-4d0d-8f62-4382ad2813b8'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:18 user nova-compute[75734]: INFO os_vif [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48')
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:56:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No VIF found with MAC fa:16:3e:30:76:b0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-ef8b80ef-5e4c-479e-9d26-a9080e04b555 req-609ac87a-a9cc-4d7b-831d-7bbadbdb505f service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef8b80ef-5e4c-479e-9d26-a9080e04b555 req-609ac87a-a9cc-4d7b-831d-7bbadbdb505f service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef8b80ef-5e4c-479e-9d26-a9080e04b555 req-609ac87a-a9cc-4d7b-831d-7bbadbdb505f service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef8b80ef-5e4c-479e-9d26-a9080e04b555 req-609ac87a-a9cc-4d7b-831d-7bbadbdb505f service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-ef8b80ef-5e4c-479e-9d26-a9080e04b555 req-609ac87a-a9cc-4d7b-831d-7bbadbdb505f service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:20 user nova-compute[75734]: WARNING nova.compute.manager [req-ef8b80ef-5e4c-479e-9d26-a9080e04b555 req-609ac87a-a9cc-4d7b-831d-7bbadbdb505f service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state building and task_state spawning.
Nov 22 15:56:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-88557606-226f-47ef-b96d-79d33310efa0 req-93997ad5-cd3b-4fc2-8ebc-abc1c67d13cc service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-88557606-226f-47ef-b96d-79d33310efa0 req-93997ad5-cd3b-4fc2-8ebc-abc1c67d13cc service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-88557606-226f-47ef-b96d-79d33310efa0 req-93997ad5-cd3b-4fc2-8ebc-abc1c67d13cc service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-88557606-226f-47ef-b96d-79d33310efa0 req-93997ad5-cd3b-4fc2-8ebc-abc1c67d13cc service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-88557606-226f-47ef-b96d-79d33310efa0 req-93997ad5-cd3b-4fc2-8ebc-abc1c67d13cc service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:22 user nova-compute[75734]: WARNING nova.compute.manager [req-88557606-226f-47ef-b96d-79d33310efa0 req-93997ad5-cd3b-4fc2-8ebc-abc1c67d13cc service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state building and task_state spawning.
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:56:22 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance spawned successfully.
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:56:22 user nova-compute[75734]: INFO nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 22 15:56:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:56:22 user nova-compute[75734]: INFO nova.compute.manager [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Took 19.99 seconds to build instance.
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9ae0a76e-8b41-4e73-a8df-8c00aead1924 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.145s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:23 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e is timed out.
Nov 22 15:56:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Successfully detached device vdb from instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e from the live domain config.
Nov 22 15:56:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvVaiukp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '609d12e6-0cdd-43b1-8917-f28605476935'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:23 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d85cabf-ebbc-4efa-9773-3351dbb3ea98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:56:23 user nova-compute[75734]: No targets found.
Nov 22 15:56:23 user nova-compute[75734]: iSNS:
Nov 22 15:56:23 user nova-compute[75734]: No targets found.
Nov 22 15:56:23 user nova-compute[75734]: STATIC:
Nov 22 15:56:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:56:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 15:56:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935
Nov 22 15:56:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17
Nov 22 15:56:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:56:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a
Nov 22 15:56:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:56:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:23 user nova-compute[75734]: FIRMWARE:
Nov 22 15:56:23 user nova-compute[75734]: No targets found.
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:56:23 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:56:23 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa3e87-5df5-426e-bdff-7aba95d55b5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf63655c-706e-4df6-b026-07a30ef25ac1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc207370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935'): ({'sdh'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Removing single pathed devices sdh {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a265abb-43ab-4c54-ab8e-8eabbffbf98f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361d051-bdd1-46ac-8fab-12e9cd5cb2fa]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Flushing IO for device /dev/sdh {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9714f3-e347-4622-b136-7768d2c52a50]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38bf4c-a6c7-40c3-8757-ce1f2bf7c6fc]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1bfc51-97e0-4df4-b2d7-73bedd3c6a6c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe35ec-ce6f-43ae-bc1d-b98a20fd0549]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260]
Nov 22 15:56:23 user nova-compute[75734]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYfcKDxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:23 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609d12e6-0cdd-43b1-8917-f28605476935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cdbac1-6eb5-461f-9001-fd007819e07d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] <== disconnect_volume: return (391ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.041s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:23 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:23 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cefd15-86f2-4a9d-b304-e658afc5a1b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:56:23 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba039401-d440-44da-805d-7beec652c8df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db] added
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569b038-7cef-4fd1-b7dc-a17cd798ace0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c396f490-ff89-4bda-a668-f600d97d48c0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYfcKDxn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYfcKDxn" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb098e-67b2-4229-b72a-d0eaf9d4152c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYfcKDxn'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e967d-4347-442c-b23a-b5cdaf1de7e3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1cbc6-e3fc-49ab-ae1a-771df549d6c9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f9880-a267-4b53-90e6-5f419955b051]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260]
Nov 22 15:56:23 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed5bfb-b661-4153-a56d-7d064c502fc1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf51db9-d38c-49d6-9dfb-016c304c94fa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17edc53-b43d-42b3-a424-e185e1a07c1a (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785917de-08ee-4d97-8bc1-d2aec89ecd17 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[120bb03f-7a19-486b-8698-2188c5d67787]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:56:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYfcKDxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:56:24 user nova-compute[75734]: DEBUG nova.objects.instance [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lazy-loading 'flavor' on Instance uuid a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e087fee-bb4d-4d20-8b4d-5e1c8404d71b tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.908s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23335383437303364', 'path': '/dev/sdh'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335383437303364', 'path': '/dev/sdh'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:56:24 user nova-compute[75734]: DEBUG nova.objects.instance [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'flavor' on Instance uuid 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:56:24 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:56:24 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:56:24 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:56:24 user nova-compute[75734]:   <serial>8640cd0b-2737-44e0-a754-9e95ccf798db</serial>
Nov 22 15:56:24 user nova-compute[75734]: </disk>
Nov 22 15:56:24 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:56:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:56:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:56:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No VIF found with MAC fa:16:3e:3f:a7:77, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:56:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e8d44f71-cc6b-4b9a-9373-266d9e1061d0 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.149s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:28 user nova-compute[75734]: INFO nova.compute.manager [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Detaching volume 8640cd0b-2737-44e0-a754-9e95ccf798db
Nov 22 15:56:28 user nova-compute[75734]: INFO nova.virt.block_device [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Attempting to driver detach volume 8640cd0b-2737-44e0-a754-9e95ccf798db from mountpoint /dev/vdb
Nov 22 15:56:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Attempting to detach device vdb from instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:56:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:56:28 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:56:28 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:56:28 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:56:28 user nova-compute[75734]:   <serial>8640cd0b-2737-44e0-a754-9e95ccf798db</serial>
Nov 22 15:56:28 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:56:28 user nova-compute[75734]: </disk>
Nov 22 15:56:28 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:56:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully detached device vdb from instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 from the persistent domain config.
Nov 22 15:56:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:56:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:56:28 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:56:28 user nova-compute[75734]:   <source dev="/dev/sdh"/>
Nov 22 15:56:28 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:56:28 user nova-compute[75734]:   <serial>8640cd0b-2737-44e0-a754-9e95ccf798db</serial>
Nov 22 15:56:28 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:56:28 user nova-compute[75734]: </disk>
Nov 22 15:56:28 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:56:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:29 user nova-compute[75734]: INFO nova.compute.manager [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Terminating instance
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-d5555016-0875-4417-93e1-4035274a73a6 req-a7162294-3fce-493e-99ca-8da21f36d21f service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-vif-unplugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d5555016-0875-4417-93e1-4035274a73a6 req-a7162294-3fce-493e-99ca-8da21f36d21f service nova] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d5555016-0875-4417-93e1-4035274a73a6 req-a7162294-3fce-493e-99ca-8da21f36d21f service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d5555016-0875-4417-93e1-4035274a73a6 req-a7162294-3fce-493e-99ca-8da21f36d21f service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-d5555016-0875-4417-93e1-4035274a73a6 req-a7162294-3fce-493e-99ca-8da21f36d21f service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] No waiting events found dispatching network-vif-unplugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-d5555016-0875-4417-93e1-4035274a73a6 req-a7162294-3fce-493e-99ca-8da21f36d21f service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-vif-unplugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Instance destroyed successfully.
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.objects.instance [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lazy-loading 'resources' on Instance uuid a0dfd979-e5f5-4ca0-b864-90c12641cfe9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1947728599',display_name='tempest-VolumesAssistedSnapshotsTest-server-1947728599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1947728599',id=7,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFVwk0tKHo23AsKEmzzheR8uK9oY7ktvAeVGDQce+wND/1F2bTnmoBjZeQUGACLfpWHQ3U2C75lxz3bkcbS5bKoGzOow/c+x/ief0qF/1ikDjFmEIahDlE49liZWo4tnQ==',key_name='tempest-keypair-1151355296',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d3a0dbac556464097ef64a6c78a3e72',ramdisk_id='',reservation_id='r-1yit0zqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1989877788',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1989877788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f145597d89594643b0626562bb72b68f',uuid=a0dfd979-e5f5-4ca0-b864-90c12641cfe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Converting VIF {"id": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "address": "fa:16:3e:3d:70:99", "network": {"id": "9fce1caf-99e0-4e06-9290-04f2c42cc62a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1747582892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3a0dbac556464097ef64a6c78a3e72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18f633a-a6", "ovs_interfaceid": "c18f633a-a6fa-40d8-b7af-38fc71569f7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:70:99,bridge_name='br-int',has_traffic_filtering=True,id=c18f633a-a6fa-40d8-b7af-38fc71569f7e,network=Network(9fce1caf-99e0-4e06-9290-04f2c42cc62a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18f633a-a6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG os_vif [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:70:99,bridge_name='br-int',has_traffic_filtering=True,id=c18f633a-a6fa-40d8-b7af-38fc71569f7e,network=Network(9fce1caf-99e0-4e06-9290-04f2c42cc62a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18f633a-a6') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc18f633a-a6, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=210621bd-4d11-4ca3-87b0-1702f87358ea) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:29 user nova-compute[75734]: INFO os_vif [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:70:99,bridge_name='br-int',has_traffic_filtering=True,id=c18f633a-a6fa-40d8-b7af-38fc71569f7e,network=Network(9fce1caf-99e0-4e06-9290-04f2c42cc62a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18f633a-a6')
Nov 22 15:56:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Deleting instance files /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9_del
Nov 22 15:56:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Deletion of /opt/stack/data/nova/instances/a0dfd979-e5f5-4ca0-b864-90c12641cfe9_del complete
Nov 22 15:56:30 user nova-compute[75734]: INFO nova.compute.manager [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 22 15:56:30 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:56:30 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:56:30 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:56:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:30 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-65231184-055e-4908-88a5-32d38d9cadab req-1a2e8a6d-3378-4fbb-bc87-e1cebd77edf1 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-vif-deleted-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:30 user nova-compute[75734]: INFO nova.compute.manager [req-65231184-055e-4908-88a5-32d38d9cadab req-1a2e8a6d-3378-4fbb-bc87-e1cebd77edf1 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Neutron deleted interface c18f633a-a6fa-40d8-b7af-38fc71569f7e; detaching it from the instance and deleting it from the info cache
Nov 22 15:56:30 user nova-compute[75734]: DEBUG nova.network.neutron [req-65231184-055e-4908-88a5-32d38d9cadab req-1a2e8a6d-3378-4fbb-bc87-e1cebd77edf1 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:30 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Took 0.82 seconds to deallocate network for instance.
Nov 22 15:56:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-65231184-055e-4908-88a5-32d38d9cadab req-1a2e8a6d-3378-4fbb-bc87-e1cebd77edf1 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Detach interface failed, port_id=c18f633a-a6fa-40d8-b7af-38fc71569f7e, reason: Instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:31 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Deleted allocations for instance a0dfd979-e5f5-4ca0-b864-90c12641cfe9
Nov 22 15:56:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-712711e3-2812-4426-ae28-3cbfda8e65e2 tempest-VolumesAssistedSnapshotsTest-1989877788 tempest-VolumesAssistedSnapshotsTest-1989877788-project-member] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-3f56031a-f8b6-413a-99d0-9c17798dece3 req-febcddf6-4325-4399-a5b1-009b8abc8bb7 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received event network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f56031a-f8b6-413a-99d0-9c17798dece3 req-febcddf6-4325-4399-a5b1-009b8abc8bb7 service nova] Acquiring lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f56031a-f8b6-413a-99d0-9c17798dece3 req-febcddf6-4325-4399-a5b1-009b8abc8bb7 service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f56031a-f8b6-413a-99d0-9c17798dece3 req-febcddf6-4325-4399-a5b1-009b8abc8bb7 service nova] Lock "a0dfd979-e5f5-4ca0-b864-90c12641cfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-3f56031a-f8b6-413a-99d0-9c17798dece3 req-febcddf6-4325-4399-a5b1-009b8abc8bb7 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] No waiting events found dispatching network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:31 user nova-compute[75734]: WARNING nova.compute.manager [req-3f56031a-f8b6-413a-99d0-9c17798dece3 req-febcddf6-4325-4399-a5b1-009b8abc8bb7 service nova] [instance: a0dfd979-e5f5-4ca0-b864-90c12641cfe9] Received unexpected event network-vif-plugged-c18f633a-a6fa-40d8-b7af-38fc71569f7e for instance with vm_state deleted and task_state None.
Nov 22 15:56:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-changed-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing instance network info cache due to event network-changed-4b63078b-be6f-4742-bb3e-5faa6da21972. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:56:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] Acquiring lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] Acquired lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Refreshing network info cache for port 4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:56:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updated VIF entry in instance network info cache for port 4b63078b-be6f-4742-bb3e-5faa6da21972. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:56:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [{"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e8b2daf0-a988-4e09-9fb3-f3a51fb6f1ff req-f629eac4-74ae-49e8-a78f-98d8cbf82294 service nova] Releasing lock "refresh_cache-bacfbd1d-ad11-486f-bd13-08d72c346b73" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:41 user nova-compute[75734]: INFO nova.compute.manager [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Terminating instance
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-17209c89-cc11-45d2-92d0-ed8fb8a180f1 req-0666ebb9-3eee-4041-8191-aae22b8e6e8e service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-17209c89-cc11-45d2-92d0-ed8fb8a180f1 req-0666ebb9-3eee-4041-8191-aae22b8e6e8e service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-17209c89-cc11-45d2-92d0-ed8fb8a180f1 req-0666ebb9-3eee-4041-8191-aae22b8e6e8e service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-17209c89-cc11-45d2-92d0-ed8fb8a180f1 req-0666ebb9-3eee-4041-8191-aae22b8e6e8e service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-17209c89-cc11-45d2-92d0-ed8fb8a180f1 req-0666ebb9-3eee-4041-8191-aae22b8e6e8e service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-unplugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-17209c89-cc11-45d2-92d0-ed8fb8a180f1 req-0666ebb9-3eee-4041-8191-aae22b8e6e8e service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-4b63078b-be6f-4742-bb3e-5faa6da21972 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-8a196925-fdeb-4326-bf26-0d94925802c4 req-2f9393bb-bfe3-4a0c-bb46-7ace57f8df9d service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8a196925-fdeb-4326-bf26-0d94925802c4 req-2f9393bb-bfe3-4a0c-bb46-7ace57f8df9d service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8a196925-fdeb-4326-bf26-0d94925802c4 req-2f9393bb-bfe3-4a0c-bb46-7ace57f8df9d service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8a196925-fdeb-4326-bf26-0d94925802c4 req-2f9393bb-bfe3-4a0c-bb46-7ace57f8df9d service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-8a196925-fdeb-4326-bf26-0d94925802c4 req-2f9393bb-bfe3-4a0c-bb46-7ace57f8df9d service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-unplugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-8a196925-fdeb-4326-bf26-0d94925802c4 req-2f9393bb-bfe3-4a0c-bb46-7ace57f8df9d service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-92b60767-112b-4298-8cbd-6d5e913f3a8e for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-6088d86d-35b8-45cf-9166-94912aee83db req-89cdd6c3-7f5d-49d8-990a-e419c811e462 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6088d86d-35b8-45cf-9166-94912aee83db req-89cdd6c3-7f5d-49d8-990a-e419c811e462 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6088d86d-35b8-45cf-9166-94912aee83db req-89cdd6c3-7f5d-49d8-990a-e419c811e462 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6088d86d-35b8-45cf-9166-94912aee83db req-89cdd6c3-7f5d-49d8-990a-e419c811e462 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-6088d86d-35b8-45cf-9166-94912aee83db req-89cdd6c3-7f5d-49d8-990a-e419c811e462 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-unplugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-6088d86d-35b8-45cf-9166-94912aee83db req-89cdd6c3-7f5d-49d8-990a-e419c811e462 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:42 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Instance destroyed successfully.
Nov 22 15:56:42 user nova-compute[75734]: DEBUG nova.objects.instance [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lazy-loading 'resources' on Instance uuid bacfbd1d-ad11-486f-bd13-08d72c346b73 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=4b63078b-be6f-4742-bb3e-5faa6da21972,network=Network(bb6bc1e9-65ae-45cf-906f-27617ec8fb67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63078b-be') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=4b63078b-be6f-4742-bb3e-5faa6da21972,network=Network(bb6bc1e9-65ae-45cf-906f-27617ec8fb67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63078b-be') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b63078b-be, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba0c6504-82ab-4802-8c5b-cdb7617e8acd) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: INFO os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=4b63078b-be6f-4742-bb3e-5faa6da21972,network=Network(bb6bc1e9-65ae-45cf-906f-27617ec8fb67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63078b-be')
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=92b60767-112b-4298-8cbd-6d5e913f3a8e,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92b60767-11') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=92b60767-112b-4298-8cbd-6d5e913f3a8e,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92b60767-11') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92b60767-11, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de1a7d4e-209e-4549-a639-b761e05b7e33) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: INFO os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=92b60767-112b-4298-8cbd-6d5e913f3a8e,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92b60767-11')
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=0d9d9b26-7f67-44fb-8242-8cf0169030f5,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0d9d9b26-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=0d9d9b26-7f67-44fb-8242-8cf0169030f5,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0d9d9b26-7f') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d9d9b26-7f, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2461bd1-58d4-4ec3-b1fd-6ffc4542274f) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: INFO os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=0d9d9b26-7f67-44fb-8242-8cf0169030f5,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0d9d9b26-7f')
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "d4678086-e1b4-4e83-af50-21261b5c12cc", "address": "fa:16:3e:08:15:01", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4678086-e1", "ovs_interfaceid": "d4678086-e1b4-4e83-af50-21261b5c12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:15:01,bridge_name='br-int',has_traffic_filtering=True,id=d4678086-e1b4-4e83-af50-21261b5c12cc,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4678086-e1') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:15:01,bridge_name='br-int',has_traffic_filtering=True,id=d4678086-e1b4-4e83-af50-21261b5c12cc,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4678086-e1') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4678086-e1, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "c158823f-476c-4691-9191-affa6e302565" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: INFO nova.compute.manager [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Terminating instance
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0aa62b7a-605c-4343-86b9-36a00c94961c) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-4f0e4838-70ef-4433-b991-27c4a3d1d0bb req-60b70785-40b3-489e-baa6-94665572b2e5 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4f0e4838-70ef-4433-b991-27c4a3d1d0bb req-60b70785-40b3-489e-baa6-94665572b2e5 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4f0e4838-70ef-4433-b991-27c4a3d1d0bb req-60b70785-40b3-489e-baa6-94665572b2e5 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4f0e4838-70ef-4433-b991-27c4a3d1d0bb req-60b70785-40b3-489e-baa6-94665572b2e5 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-4f0e4838-70ef-4433-b991-27c4a3d1d0bb req-60b70785-40b3-489e-baa6-94665572b2e5 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING nova.compute.manager [req-4f0e4838-70ef-4433-b991-27c4a3d1d0bb req-60b70785-40b3-489e-baa6-94665572b2e5 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-4b63078b-be6f-4742-bb3e-5faa6da21972 for instance with vm_state active and task_state deleting.
Nov 22 15:56:43 user nova-compute[75734]: INFO os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:15:01,bridge_name='br-int',has_traffic_filtering=True,id=d4678086-e1b4-4e83-af50-21261b5c12cc,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4678086-e1')
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a5:75,bridge_name='br-int',has_traffic_filtering=True,id=b2c85b76-2687-490e-a4fb-60964d4d251a,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c85b76-26') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a5:75,bridge_name='br-int',has_traffic_filtering=True,id=b2c85b76-2687-490e-a4fb-60964d4d251a,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c85b76-26') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2c85b76-26, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b8ec5d9-ce60-414a-ba4a-753923bb72fc) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: INFO os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a5:75,bridge_name='br-int',has_traffic_filtering=True,id=b2c85b76-2687-490e-a4fb-60964d4d251a,network=Network(cdb666f4-9541-430e-8cf9-e1baadf9956b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c85b76-26')
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:4e,bridge_name='br-int',has_traffic_filtering=True,id=f44ead43-8018-4ae5-b91b-ab3a137d98e5,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf44ead43-80') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:4e,bridge_name='br-int',has_traffic_filtering=True,id=f44ead43-8018-4ae5-b91b-ab3a137d98e5,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf44ead43-80') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf44ead43-80, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-92b60767-112b-4298-8cbd-6d5e913f3a8e for instance with vm_state active and task_state deleting.
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-unplugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-d4678086-e1b4-4e83-af50-21261b5c12cc for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-d4678086-e1b4-4e83-af50-21261b5c12cc for instance with vm_state active and task_state deleting.
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-unplugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-b2c85b76-2687-490e-a4fb-60964d4d251a for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-b2c85b76-2687-490e-a4fb-60964d4d251a for instance with vm_state active and task_state deleting.
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-unplugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING nova.compute.manager [req-d0e26e32-36b2-43a1-96d4-9999caf7f3c0 req-0d0cef0c-eec6-4f70-8db1-bdf21faf9757 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-f44ead43-8018-4ae5-b91b-ab3a137d98e5 for instance with vm_state active and task_state deleting.
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87e8195a-18f0-4998-8f29-54fa732731d1) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: INFO os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8c:4e,bridge_name='br-int',has_traffic_filtering=True,id=f44ead43-8018-4ae5-b91b-ab3a137d98e5,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf44ead43-80')
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-74135548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-74135548',id=8,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6l0l2MWVWW3xiFpvckSHZMdtotDiLzVCi88Fhc+Yrx2A5tdjXZzariUKgZc2KzWmtQbl8jT8OoqnwVDxR2pddL1vzlpHRL7ZUzasY0zxAqCEEsvW4REjsJUAE02mA6eg==',key_name='tempest-keypair-1515005712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e20d284a3e4c61ac15f148ff7a776c',ramdisk_id='',reservation_id='r-hmsxu14z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-578229687',owner_user_name='tempest-TaggedBootDevicesTest_v242-578229687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d077e3c6eb942f7a76262ac2d92b3b5',uuid=bacfbd1d-ad11-486f-bd13-08d72c346b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converting VIF {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:52:36,bridge_name='br-int',has_traffic_filtering=True,id=0eac44a6-a860-41bb-9b1f-31a419beeacb,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac44a6-a8') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:52:36,bridge_name='br-int',has_traffic_filtering=True,id=0eac44a6-a860-41bb-9b1f-31a419beeacb,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac44a6-a8') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0eac44a6-a8, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-0d9d9b26-7f67-44fb-8242-8cf0169030f5 for instance with vm_state active and task_state deleting.
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-unplugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-unplugged-0eac44a6-a860-41bb-9b1f-31a419beeacb for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Acquiring lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] No waiting events found dispatching network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING nova.compute.manager [req-8833edac-83ee-483f-b0fe-f748ffe87c87 req-e7eeb78f-1266-4738-8a36-c7f898ef1103 service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received unexpected event network-vif-plugged-0eac44a6-a860-41bb-9b1f-31a419beeacb for instance with vm_state active and task_state deleting.
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=152e20c6-ddbd-4a65-a10f-7c57c58a2ce0) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:43 user nova-compute[75734]: INFO os_vif [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:52:36,bridge_name='br-int',has_traffic_filtering=True,id=0eac44a6-a860-41bb-9b1f-31a419beeacb,network=Network(d2f362c3-a697-4852-9a05-b3087c333089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac44a6-a8')
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nyuOXgMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:43 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd5a32a-0622-4546-98b0-fbfb937f7943]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:56:43 user nova-compute[75734]: No targets found.
Nov 22 15:56:43 user nova-compute[75734]: iSNS:
Nov 22 15:56:43 user nova-compute[75734]: No targets found.
Nov 22 15:56:43 user nova-compute[75734]: STATIC:
Nov 22 15:56:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5
Nov 22 15:56:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db
Nov 22 15:56:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 15:56:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:56:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:56:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:43 user nova-compute[75734]: FIRMWARE:
Nov 22 15:56:43 user nova-compute[75734]: No targets found.
Nov 22 15:56:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:56:43 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:56:43 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568f5f1-c765-4bda-931c-8d35a1033c28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edb2bc7-366d-4596-8251-04c3810c69c7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:43 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7b3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5'): ({'sde'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Removing single pathed devices sde {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c4cf17-d7ef-4e10-8821-58a9081d69e7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a1148b-3426-4768-9c03-93d633f5850a]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Flushing IO for device /dev/sde {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f919b94-a40d-43b3-ba92-5b4d9cffa938]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:56:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.068s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b9428e-344c-4f3d-9aa4-50b9c8ee3992]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[169db9dc-7ebd-4e91-b344-95fa224233e0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[70528720-b02c-41cf-bf79-df17860302ab]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260]
Nov 22 15:56:44 user nova-compute[75734]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfdef766-3310-4f9d-8d37-07960c0abcb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e39fe8a-3ad4-432d-8fae-6dfa48259041]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== disconnect_volume: return (407ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGdOjIkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:44 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c158823f-476c-4691-9191-affa6e302565] Instance destroyed successfully.
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.objects.instance [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lazy-loading 'resources' on Instance uuid c158823f-476c-4691-9191-affa6e302565 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e6f62-ef71-47ed-8bb0-1599369866bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:56:44 user nova-compute[75734]: No targets found.
Nov 22 15:56:44 user nova-compute[75734]: iSNS:
Nov 22 15:56:44 user nova-compute[75734]: No targets found.
Nov 22 15:56:44 user nova-compute[75734]: STATIC:
Nov 22 15:56:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db
Nov 22 15:56:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 15:56:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67
Nov 22 15:56:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:56:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:44 user nova-compute[75734]: FIRMWARE:
Nov 22 15:56:44 user nova-compute[75734]: No targets found.
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:56:44 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:56:44 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-942617789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-942617789',id=6,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMWAejrFaZLP+BeNEN840ruDDDaklu3qOKcu9IgE5e8a1T9xZH/gXHcpfuUnJk/1/vla3pkA7R2D1w5Ha8/ipZ67bLQVNcr8BhRF4c9TBRn0toHdqsueejhDTztr0TM+w==',key_name='tempest-keypair-683284720',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e08ca1d63bf409ba53a06635e0fdb27',ramdisk_id='',reservation_id='r-se1ytmu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-49264513',owner_user_name='tempest-TaggedAttachmentsTest-49264513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ae04e9a5bfa4c4088140b509e449832',uuid=c158823f-476c-4691-9191-affa6e302565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converting VIF {"id": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "address": "fa:16:3e:0f:10:66", "network": {"id": "ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1098212571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e08ca1d63bf409ba53a06635e0fdb27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22d78f0a-27", "ovs_interfaceid": "22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:10:66,bridge_name='br-int',has_traffic_filtering=True,id=22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5,network=Network(ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d78f0a-27') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_vif [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:10:66,bridge_name='br-int',has_traffic_filtering=True,id=22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5,network=Network(ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d78f0a-27') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad92b128-b544-4015-a34c-9ec2bbcc47ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22d78f0a-27, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15dd06ab-ba98-4772-9705-35027d3e4edc) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:44 user nova-compute[75734]: INFO os_vif [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:10:66,bridge_name='br-int',has_traffic_filtering=True,id=22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5,network=Network(ea6b31e1-a6da-4b29-a27e-9a9b7cea87b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22d78f0a-27')
Nov 22 15:56:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Deleting instance files /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565_del
Nov 22 15:56:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Deletion of /opt/stack/data/nova/instances/c158823f-476c-4691-9191-affa6e302565_del complete
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175cee9-fce8-4ce0-a146-35e500f5dab0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7b1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67'): ({'sdf'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Removing single pathed devices sdf {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[204fb100-936d-44f6-a121-696e3e6ff38b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a292719d-da54-496f-9a8a-41faee038945]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Flushing IO for device /dev/sdf {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: INFO nova.compute.manager [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] [instance: c158823f-476c-4691-9191-affa6e302565] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: c158823f-476c-4691-9191-affa6e302565] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c158823f-476c-4691-9191-affa6e302565] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b1ed6-8317-4706-8bb0-f47a16f58bff]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7794949e-cfd5-4b08-bd93-8f6ec4607e71]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] SCSI volumes sdf have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5908935b-b1d6-475a-a684-c392a2128bba]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[654c5986-899c-409b-b6c5-2f63f4e996c5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260]
Nov 22 15:56:44 user nova-compute[75734]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updating instance_info_cache with network_info: [{"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f398841-16c2-4578-822c-7ac9d8440f67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5592655c-b8cb-408f-a9b8-75f037a2f267]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== disconnect_volume: return (349ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLgVysJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:44 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-02833b01-4e0b-404a-8aae-d47fa0ac6794" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b474fbf3-c044-4c86-a5c3-ceb1d98877bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:56:44 user nova-compute[75734]: No targets found.
Nov 22 15:56:44 user nova-compute[75734]: iSNS:
Nov 22 15:56:44 user nova-compute[75734]: No targets found.
Nov 22 15:56:44 user nova-compute[75734]: STATIC:
Nov 22 15:56:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db
Nov 22 15:56:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 15:56:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890
Nov 22 15:56:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:44 user nova-compute[75734]: FIRMWARE:
Nov 22 15:56:44 user nova-compute[75734]: No targets found.
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:56:44 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:56:44 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6aa9ac-eb68-40e8-80c5-829cf1e91473]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12b3d4e-87d6-4b82-a1ca-1ddba88c6819]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:44 user nova-compute[75734]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 (non-flash)
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc080d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890'): ({'sdg'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Removing single pathed devices sdg {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b69ff79-fba8-4ce6-b078-5b41f89b272b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1239be4e-8a3d-46df-b6fe-205d1fc7da5a]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Flushing IO for device /dev/sdg {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaa6e37-13e0-4dbb-bf24-45544e07326b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb73ac82-e1ff-4353-981d-ae618bb8a724]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a882d93f-77d9-4b4a-86d3-9b199ee5fdaf]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da1bab-3b47-4e80-94b6-c692b307003c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260]
Nov 22 15:56:44 user nova-compute[75734]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3e586d-ca8c-475f-8486-0fe169db2890 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d6f451-2e37-4ebb-b5db-a79437fe6a28]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] <== disconnect_volume: return (329ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:56:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Deleting instance files /opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73_del
Nov 22 15:56:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Deletion of /opt/stack/data/nova/instances/bacfbd1d-ad11-486f-bd13-08d72c346b73_del complete
Nov 22 15:56:44 user nova-compute[75734]: INFO nova.compute.manager [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Took 3.88 seconds to destroy the instance on the hypervisor.
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-unplugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-unplugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-unplugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] Acquiring lock "c158823f-476c-4691-9191-affa6e302565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] Lock "c158823f-476c-4691-9191-affa6e302565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] No waiting events found dispatching network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:45 user nova-compute[75734]: WARNING nova.compute.manager [req-79c574fd-40cb-4a30-8445-56c633e51443 req-2fe4b093-483a-4c5b-9fcf-e2e4591bdd91 service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received unexpected event network-vif-plugged-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 for instance with vm_state active and task_state deleting.
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c158823f-476c-4691-9191-affa6e302565] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:46 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: c158823f-476c-4691-9191-affa6e302565] Took 1.82 seconds to deallocate network for instance.
Nov 22 15:56:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-a99858cb-0a8f-43f8-bf8c-0124c9d601a0 req-9a746af0-1a9b-4367-b362-0d9810003d0b service nova] [instance: c158823f-476c-4691-9191-affa6e302565] Received event network-vif-deleted-22d78f0a-2742-4bc5-ba8f-07ea0ba5cfb5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:46 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Deleted allocations for instance c158823f-476c-4691-9191-affa6e302565
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e923c1f3-5d61-4cbf-ab0b-b0c333e7754e tempest-TaggedAttachmentsTest-49264513 tempest-TaggedAttachmentsTest-49264513-project-member] Lock "c158823f-476c-4691-9191-affa6e302565" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.536s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-deleted-d4678086-e1b4-4e83-af50-21261b5c12cc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:48 user nova-compute[75734]: INFO nova.compute.manager [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Neutron deleted interface d4678086-e1b4-4e83-af50-21261b5c12cc; detaching it from the instance and deleting it from the info cache
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.network.neutron [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [{"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "address": "fa:16:3e:e4:8c:4e", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf44ead43-80", "ovs_interfaceid": "f44ead43-8018-4ae5-b91b-ab3a137d98e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:48 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:56:48 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=25.38573455810547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Detach interface failed, port_id=d4678086-e1b4-4e83-af50-21261b5c12cc, reason: Instance bacfbd1d-ad11-486f-bd13-08d72c346b73 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-deleted-f44ead43-8018-4ae5-b91b-ab3a137d98e5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:48 user nova-compute[75734]: INFO nova.compute.manager [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Neutron deleted interface f44ead43-8018-4ae5-b91b-ab3a137d98e5; detaching it from the instance and deleting it from the info cache
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.network.neutron [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [{"id": "4b63078b-be6f-4742-bb3e-5faa6da21972", "address": "fa:16:3e:18:43:6b", "network": {"id": "bb6bc1e9-65ae-45cf-906f-27617ec8fb67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-523376305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63078b-be", "ovs_interfaceid": "4b63078b-be6f-4742-bb3e-5faa6da21972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "address": "fa:16:3e:c0:36:ae", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b60767-11", "ovs_interfaceid": "92b60767-112b-4298-8cbd-6d5e913f3a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "address": "fa:16:3e:cd:f5:91", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d9b26-7f", "ovs_interfaceid": "0d9d9b26-7f67-44fb-8242-8cf0169030f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c85b76-2687-490e-a4fb-60964d4d251a", "address": "fa:16:3e:b8:a5:75", "network": {"id": "cdb666f4-9541-430e-8cf9-e1baadf9956b", "bridge": "br-int", "label": "tempest-device-tagging-net1-454117451", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c85b76-26", "ovs_interfaceid": "b2c85b76-2687-490e-a4fb-60964d4d251a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "address": "fa:16:3e:04:52:36", "network": {"id": "d2f362c3-a697-4852-9a05-b3087c333089", "bridge": "br-int", "label": "tempest-device-tagging-net2-831658488", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0e20d284a3e4c61ac15f148ff7a776c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac44a6-a8", "ovs_interfaceid": "0eac44a6-a860-41bb-9b1f-31a419beeacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-357abac0-6b78-4f36-b9d2-90fea222342e req-a882f8be-c6ad-4ece-99af-fe40a1261a0f service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Detach interface failed, port_id=f44ead43-8018-4ae5-b91b-ab3a137d98e5, reason: Instance bacfbd1d-ad11-486f-bd13-08d72c346b73 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance bacfbd1d-ad11-486f-bd13-08d72c346b73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9fb1125f-ce45-4cb6-83a0-d90e92f2569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:56:48 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 is timed out.
Nov 22 15:56:48 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully detached device vdb from instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 from the live domain config.
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYfcKDxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:56:48 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:56:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a4cd8-b039-497d-8e3f-00deefc05c8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:56:48 user nova-compute[75734]: No targets found.
Nov 22 15:56:48 user nova-compute[75734]: iSNS:
Nov 22 15:56:48 user nova-compute[75734]: No targets found.
Nov 22 15:56:48 user nova-compute[75734]: STATIC:
Nov 22 15:56:48 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db
Nov 22 15:56:48 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:48 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:48 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 15:56:48 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:56:48 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:56:48 user nova-compute[75734]: FIRMWARE:
Nov 22 15:56:48 user nova-compute[75734]: No targets found.
Nov 22 15:56:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:56:48 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:56:48 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[64667dba-221c-4db4-8a27-4db650762d0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[574bd7cc-cb5b-484b-af71-129c217c3d33]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:49 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:56:49 user nova-compute[75734]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db (non-flash)
Nov 22 15:56:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc2075b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db'): ({'sdh'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Removing single pathed devices sdh {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e638fd-1d77-4735-aa36-8b11390441e1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f72da84-c013-4716-9d06-c7b1bb5322a7]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Flushing IO for device /dev/sdh {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e2d150-c57c-49db-af6b-3a462fa9018f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b4be61-ec58-4c22-9ea9-03ff7d3aab75]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb5b495-14f1-4d3d-bcaf-a6ccb796d2dc]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc662c22-321e-42d4-9766-c9b8e92c370b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260]
Nov 22 15:56:49 user nova-compute[75734]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db, portal: 172.16.0.220,3260] successful.
Nov 22 15:56:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8640cd0b-2737-44e0-a754-9e95ccf798db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8427bc0-cb0d-4bfd-b9dc-5dc6f20f36b6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] <== disconnect_volume: return (315ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:56:49 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:49 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Took 4.52 seconds to deallocate network for instance.
Nov 22 15:56:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'flavor' on Instance uuid 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca88e16c-db50-4770-9a78-9816ee8fac92 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-34239993-66c4-441e-a320-6e4fd769fa87 req-db423265-b04c-46a6-a659-77e055644d0c service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-deleted-4b63078b-be6f-4742-bb3e-5faa6da21972 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-34239993-66c4-441e-a320-6e4fd769fa87 req-db423265-b04c-46a6-a659-77e055644d0c service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-deleted-b2c85b76-2687-490e-a4fb-60964d4d251a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-34239993-66c4-441e-a320-6e4fd769fa87 req-db423265-b04c-46a6-a659-77e055644d0c service nova] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Received event network-vif-deleted-0eac44a6-a860-41bb-9b1f-31a419beeacb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:56:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:56:52 user nova-compute[75734]: INFO nova.compute.manager [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] [instance: bacfbd1d-ad11-486f-bd13-08d72c346b73] Took 2.94 seconds to detach 3 volumes for instance.
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:52 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Deleted allocations for instance bacfbd1d-ad11-486f-bd13-08d72c346b73
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-58aaa89c-a7db-47ba-9940-fed0799b5973 tempest-TaggedBootDevicesTest_v242-578229687 tempest-TaggedBootDevicesTest_v242-578229687-project-member] Lock "bacfbd1d-ad11-486f-bd13-08d72c346b73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.853s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:52 user nova-compute[75734]: INFO nova.compute.manager [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Terminating instance
Nov 22 15:56:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-0f50c2d2-14b8-4414-a2f9-500fdc44c4c0 req-2a819774-d88a-4dd9-9510-13883db75569 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-vif-unplugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0f50c2d2-14b8-4414-a2f9-500fdc44c4c0 req-2a819774-d88a-4dd9-9510-13883db75569 service nova] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0f50c2d2-14b8-4414-a2f9-500fdc44c4c0 req-2a819774-d88a-4dd9-9510-13883db75569 service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0f50c2d2-14b8-4414-a2f9-500fdc44c4c0 req-2a819774-d88a-4dd9-9510-13883db75569 service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-0f50c2d2-14b8-4414-a2f9-500fdc44c4c0 req-2a819774-d88a-4dd9-9510-13883db75569 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] No waiting events found dispatching network-vif-unplugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-0f50c2d2-14b8-4414-a2f9-500fdc44c4c0 req-2a819774-d88a-4dd9-9510-13883db75569 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-vif-unplugged-e408954b-2896-43b1-a721-32a773a0008c for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Instance destroyed successfully.
Nov 22 15:56:54 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lazy-loading 'resources' on Instance uuid a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1127049951',display_name='tempest-TestVolumeSwap-server-1127049951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1127049951',id=5,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAeuO3Wqy8Ay7vtVTVcHL5LWeah0dVmv4cC6mr3B6XvvTAAal1hzvI3GZ5SkasRwPrXszDvLYwJ3O3GVohrUx0bFGSke9w46vqODh7QnaqOKgZUfKKKnN/ytEI45f6Edg==',key_name='tempest-keypair-48993993',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68bb98a544c0407bb4629239134c9404',ramdisk_id='',reservation_id='r-o1mmuesy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-535208830',owner_user_name='tempest-TestVolumeSwap-535208830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d666933fdf74e4e8fad7a7112d1eecb',uuid=a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Converting VIF {"id": "e408954b-2896-43b1-a721-32a773a0008c", "address": "fa:16:3e:07:e1:53", "network": {"id": "0bae00f6-4943-4f4f-bfcf-8662c8b4a56a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2132116002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68bb98a544c0407bb4629239134c9404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape408954b-28", "ovs_interfaceid": "e408954b-2896-43b1-a721-32a773a0008c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:e1:53,bridge_name='br-int',has_traffic_filtering=True,id=e408954b-2896-43b1-a721-32a773a0008c,network=Network(0bae00f6-4943-4f4f-bfcf-8662c8b4a56a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape408954b-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG os_vif [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:e1:53,bridge_name='br-int',has_traffic_filtering=True,id=e408954b-2896-43b1-a721-32a773a0008c,network=Network(0bae00f6-4943-4f4f-bfcf-8662c8b4a56a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape408954b-28') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape408954b-28, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ea7e940-998a-4c82-b390-ddd0e9cc0f08) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:56:54 user nova-compute[75734]: INFO os_vif [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:e1:53,bridge_name='br-int',has_traffic_filtering=True,id=e408954b-2896-43b1-a721-32a773a0008c,network=Network(0bae00f6-4943-4f4f-bfcf-8662c8b4a56a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape408954b-28')
Nov 22 15:56:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Deleting instance files /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e_del
Nov 22 15:56:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Deletion of /opt/stack/data/nova/instances/a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e_del complete
Nov 22 15:56:54 user nova-compute[75734]: INFO nova.compute.manager [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 22 15:56:54 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:56:54 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:56:55 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Took 0.90 seconds to deallocate network for instance.
Nov 22 15:56:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-4c343e65-0125-4940-990b-651f02fd7d69 req-850c3041-3c36-4b03-9975-3248a452c618 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-vif-deleted-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:55 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Deleted allocations for instance a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e
Nov 22 15:56:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ca8bf625-4f97-49f9-b22b-78e95150a778 tempest-TestVolumeSwap-535208830 tempest-TestVolumeSwap-535208830-project-member] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-f1b27656-2d83-4098-a6d3-a452fa70811c req-9d34a2fb-c458-4c77-bbaf-e6a9e5385843 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received event network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f1b27656-2d83-4098-a6d3-a452fa70811c req-9d34a2fb-c458-4c77-bbaf-e6a9e5385843 service nova] Acquiring lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f1b27656-2d83-4098-a6d3-a452fa70811c req-9d34a2fb-c458-4c77-bbaf-e6a9e5385843 service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f1b27656-2d83-4098-a6d3-a452fa70811c req-9d34a2fb-c458-4c77-bbaf-e6a9e5385843 service nova] Lock "a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:56:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-f1b27656-2d83-4098-a6d3-a452fa70811c req-9d34a2fb-c458-4c77-bbaf-e6a9e5385843 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] No waiting events found dispatching network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:56:55 user nova-compute[75734]: WARNING nova.compute.manager [req-f1b27656-2d83-4098-a6d3-a452fa70811c req-9d34a2fb-c458-4c77-bbaf-e6a9e5385843 service nova] [instance: a4bbbef7-90f2-4ec6-93a7-eae39dfc0a1e] Received unexpected event network-vif-plugged-e408954b-2896-43b1-a721-32a773a0008c for instance with vm_state deleted and task_state None.
Nov 22 15:56:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:57:15 user nova-compute[75734]: INFO nova.compute.claims [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Claim successful on node user
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:57:15 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.policy [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b585828df0c4d2786a02ff5621a0732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d179eb8ada444378bb4412630b6e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:57:15 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Creating image(s)
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk 1073741824" returned: 0 in 0.063s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Successfully created port: 15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Cannot resize image /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Ensure instance console log exists: /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Successfully updated port: 15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-changed-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Refreshing instance network info cache due to event network-changed-15e6a34b-4d97-4ae0-849e-8f64c4043ddd. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance network_info: |[{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Refreshing network info cache for port 15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Start _get_guest_xml network_info=[{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:57:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.objects.instance [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:57:17 user nova-compute[75734]:   <uuid>5dbde2ab-53f7-46db-a454-bcc8980833dc</uuid>
Nov 22 15:57:17 user nova-compute[75734]:   <name>instance-0000000d</name>
Nov 22 15:57:17 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:57:17 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:57:17 user nova-compute[75734]:   <metadata>
Nov 22 15:57:17 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:57:17 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:57:17 user nova-compute[75734]:       <nova:name>tempest-ServerActionsTestOtherB-server-707148199</nova:name>
Nov 22 15:57:17 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:57:17</nova:creationTime>
Nov 22 15:57:17 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:57:17 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:57:17 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:57:17 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:57:17 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:57:17 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:57:17 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:57:17 user nova-compute[75734]:       <nova:owner>
Nov 22 15:57:17 user nova-compute[75734]:         <nova:user uuid="4b585828df0c4d2786a02ff5621a0732">tempest-ServerActionsTestOtherB-1674044799-project-member</nova:user>
Nov 22 15:57:17 user nova-compute[75734]:         <nova:project uuid="5d179eb8ada444378bb4412630b6e12a">tempest-ServerActionsTestOtherB-1674044799</nova:project>
Nov 22 15:57:17 user nova-compute[75734]:       </nova:owner>
Nov 22 15:57:17 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:57:17 user nova-compute[75734]:       <nova:ports>
Nov 22 15:57:17 user nova-compute[75734]:         <nova:port uuid="15e6a34b-4d97-4ae0-849e-8f64c4043ddd">
Nov 22 15:57:17 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 15:57:17 user nova-compute[75734]:         </nova:port>
Nov 22 15:57:17 user nova-compute[75734]:       </nova:ports>
Nov 22 15:57:17 user nova-compute[75734]:     </nova:instance>
Nov 22 15:57:17 user nova-compute[75734]:   </metadata>
Nov 22 15:57:17 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:57:17 user nova-compute[75734]:     <system>
Nov 22 15:57:17 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:57:17 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:57:17 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:57:17 user nova-compute[75734]:       <entry name="serial">5dbde2ab-53f7-46db-a454-bcc8980833dc</entry>
Nov 22 15:57:17 user nova-compute[75734]:       <entry name="uuid">5dbde2ab-53f7-46db-a454-bcc8980833dc</entry>
Nov 22 15:57:17 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:57:17 user nova-compute[75734]:     </system>
Nov 22 15:57:17 user nova-compute[75734]:   </sysinfo>
Nov 22 15:57:17 user nova-compute[75734]:   <os>
Nov 22 15:57:17 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:57:17 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:57:17 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:57:17 user nova-compute[75734]:   </os>
Nov 22 15:57:17 user nova-compute[75734]:   <features>
Nov 22 15:57:17 user nova-compute[75734]:     <acpi/>
Nov 22 15:57:17 user nova-compute[75734]:     <apic/>
Nov 22 15:57:17 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:57:17 user nova-compute[75734]:   </features>
Nov 22 15:57:17 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:57:17 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:57:17 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:57:17 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:57:17 user nova-compute[75734]:   </clock>
Nov 22 15:57:17 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:57:17 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:57:17 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:57:17 user nova-compute[75734]:   </cpu>
Nov 22 15:57:17 user nova-compute[75734]:   <devices>
Nov 22 15:57:17 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:57:17 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:57:17 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk"/>
Nov 22 15:57:17 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:57:17 user nova-compute[75734]:     </disk>
Nov 22 15:57:17 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:57:17 user nova-compute[75734]:       <mac address="fa:16:3e:26:22:8a"/>
Nov 22 15:57:17 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:17 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:57:17 user nova-compute[75734]:       <target dev="tap15e6a34b-4d"/>
Nov 22 15:57:17 user nova-compute[75734]:     </interface>
Nov 22 15:57:17 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:57:17 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/console.log" append="off"/>
Nov 22 15:57:17 user nova-compute[75734]:     </serial>
Nov 22 15:57:17 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:57:17 user nova-compute[75734]:     <video>
Nov 22 15:57:17 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:17 user nova-compute[75734]:     </video>
Nov 22 15:57:17 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:57:17 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:57:17 user nova-compute[75734]:     </rng>
Nov 22 15:57:17 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:57:17 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:57:17 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:57:17 user nova-compute[75734]:     </memballoon>
Nov 22 15:57:17 user nova-compute[75734]:   </devices>
Nov 22 15:57:17 user nova-compute[75734]: </domain>
Nov 22 15:57:17 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG os_vif [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbc2679d-5524-5c99-91e9-8e5ce0b5058a', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e6a34b-4d, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15e6a34b-4d, col_values=(('qos', UUID('b4313752-7464-406f-91e9-2fbb98a7f26a')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15e6a34b-4d, col_values=(('external_ids', {'iface-id': '15e6a34b-4d97-4ae0-849e-8f64c4043ddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:22:8a', 'vm-uuid': '5dbde2ab-53f7-46db-a454-bcc8980833dc'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:17 user nova-compute[75734]: INFO os_vif [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d')
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No VIF found with MAC fa:16:3e:26:22:8a, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updated VIF entry in instance network info cache for port 15e6a34b-4d97-4ae0-849e-8f64c4043ddd. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:57:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0528200b-f10d-42ae-80a0-19d7b92df781 req-3bfc141a-5e1b-4dd2-be65-649805f060b4 service nova] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-787e355d-0093-4b5b-8450-e073a851ffa2 req-b86f8e1e-d973-42c1-b1b1-9674a6c9c72c service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-787e355d-0093-4b5b-8450-e073a851ffa2 req-b86f8e1e-d973-42c1-b1b1-9674a6c9c72c service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-787e355d-0093-4b5b-8450-e073a851ffa2 req-b86f8e1e-d973-42c1-b1b1-9674a6c9c72c service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-787e355d-0093-4b5b-8450-e073a851ffa2 req-b86f8e1e-d973-42c1-b1b1-9674a6c9c72c service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-787e355d-0093-4b5b-8450-e073a851ffa2 req-b86f8e1e-d973-42c1-b1b1-9674a6c9c72c service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:18 user nova-compute[75734]: WARNING nova.compute.manager [req-787e355d-0093-4b5b-8450-e073a851ffa2 req-b86f8e1e-d973-42c1-b1b1-9674a6c9c72c service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state building and task_state spawning.
Nov 22 15:57:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:57:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:57:20 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance spawned successfully.
Nov 22 15:57:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-e80a1e23-afb5-4101-8f82-605bb856b716 req-36f01135-3bfd-4916-a0f1-6ab11bcd64f6 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e80a1e23-afb5-4101-8f82-605bb856b716 req-36f01135-3bfd-4916-a0f1-6ab11bcd64f6 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e80a1e23-afb5-4101-8f82-605bb856b716 req-36f01135-3bfd-4916-a0f1-6ab11bcd64f6 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e80a1e23-afb5-4101-8f82-605bb856b716 req-36f01135-3bfd-4916-a0f1-6ab11bcd64f6 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-e80a1e23-afb5-4101-8f82-605bb856b716 req-36f01135-3bfd-4916-a0f1-6ab11bcd64f6 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:21 user nova-compute[75734]: WARNING nova.compute.manager [req-e80a1e23-afb5-4101-8f82-605bb856b716 req-36f01135-3bfd-4916-a0f1-6ab11bcd64f6 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state building and task_state spawning.
Nov 22 15:57:21 user nova-compute[75734]: INFO nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 22 15:57:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:57:21 user nova-compute[75734]: INFO nova.compute.manager [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Took 6.23 seconds to build instance.
Nov 22 15:57:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99593c94-1d2a-4560-bfdc-aaf8593bde0b tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.319s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:57:22 user nova-compute[75734]: INFO nova.compute.manager [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] instance snapshotting
Nov 22 15:57:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Beginning live snapshot process
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.199s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz0y2khsr/4b4abcc0b4114eda900449c49b44542f.delta 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz0y2khsr/4b4abcc0b4114eda900449c49b44542f.delta 1073741824" returned: 0 in 0.051s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 15:57:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:57:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 15:57:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 15:57:25 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 15:57:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz0y2khsr/4b4abcc0b4114eda900449c49b44542f.delta /opt/stack/data/nova/instances/snapshots/tmpz0y2khsr/4b4abcc0b4114eda900449c49b44542f {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz0y2khsr/4b4abcc0b4114eda900449c49b44542f.delta /opt/stack/data/nova/instances/snapshots/tmpz0y2khsr/4b4abcc0b4114eda900449c49b44542f" returned: 0 in 0.415s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Snapshot extracted, beginning image upload
Nov 22 15:57:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Snapshot image upload complete
Nov 22 15:57:28 user nova-compute[75734]: INFO nova.compute.manager [None req-dc2d244b-b48b-4602-bc75-6a43a2ead127 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Took 5.39 seconds to snapshot the instance on the hypervisor.
Nov 22 15:57:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:57:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:57:30 user nova-compute[75734]: INFO nova.compute.claims [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Claim successful on node user
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:57:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.policy [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c080eee08c34b80ae54aa0ed9893c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8378dfb8a70149df8f2cb392ee80e44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:57:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Creating image(s)
Nov 22 15:57:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "/opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "/opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "/opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "4db6f9a3e13442f3c9fc3b02f17001030781dcda" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "4db6f9a3e13442f3c9fc3b02f17001030781dcda" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Successfully created port: ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG nova.virt.images [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] 57efd17e-73d7-4e04-926d-c44542a2f48c was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.part /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.part /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.converted" returned: 0 in 0.427s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "4db6f9a3e13442f3c9fc3b02f17001030781dcda" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.701s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda --force-share --output=json" returned: 0 in 0.165s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "4db6f9a3e13442f3c9fc3b02f17001030781dcda" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "4db6f9a3e13442f3c9fc3b02f17001030781dcda" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Successfully updated port: ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquired lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-changed-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Refreshing instance network info cache due to event network-changed-ab43788f-b69c-451f-ae7c-7bd41aca36a7. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] Acquiring lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda,backing_fmt=raw /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda,backing_fmt=raw /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk 1073741824" returned: 0 in 0.053s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "4db6f9a3e13442f3c9fc3b02f17001030781dcda" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Ensure instance console log exists: /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updating instance_info_cache with network_info: [{"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Releasing lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Instance network_info: |[{"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] Acquired lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.neutron [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Refreshing network info cache for port ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Start _get_guest_xml network_info=[{"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='197693578656a231b20f77af9b6e3506',container_format='bare',created_at=2023-11-22T15:57:23Z,direct_url=<?>,disk_format='qcow2',id=57efd17e-73d7-4e04-926d-c44542a2f48c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-192382477',owner='8378dfb8a70149df8f2cb392ee80e44f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T15:57:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '57efd17e-73d7-4e04-926d-c44542a2f48c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:57:33 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:33 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='197693578656a231b20f77af9b6e3506',container_format='bare',created_at=2023-11-22T15:57:23Z,direct_url=<?>,disk_format='qcow2',id=57efd17e-73d7-4e04-926d-c44542a2f48c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-192382477',owner='8378dfb8a70149df8f2cb392ee80e44f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T15:57:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-169801306',display_name='tempest-TestStampPattern-server-169801306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-169801306',id=14,image_ref='57efd17e-73d7-4e04-926d-c44542a2f48c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr2F0xWX4V7cn83ISOfWR0ZWxAnt6203RwWMULSxvl2kcpmW50rLf6b1v+ZQY/JOZAnLEv+bGDYOSPNFyXR/xFl+3u2Yo1jVj5aBO/pRMHr8SQlBV/9R2tVPWk55zdVYA==',key_name='tempest-TestStampPattern-1711431298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8378dfb8a70149df8f2cb392ee80e44f',ramdisk_id='',reservation_id='r-mhnf0dwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3',image_min_disk='1',image_min_ram='0',image_owner_id='8378dfb8a70149df8f2cb392ee80e44f',image_owner_project_name='tempest-TestStampPattern-2140441883',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2140441883-project-member',image_user_id='9c080eee08c34b80ae54aa0ed9893c4c',network_allocated='True',owner_project_name='tempest-TestStampPattern-2140441883',owner_user_name='tempest-TestStampPattern-2140441883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:57:31Z,user_data=None,user_id='9c080eee08c34b80ae54aa0ed9893c4c',uuid=d17ec0bc-ab9f-4127-b22c-2023ff1c0e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converting VIF {"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:39:b0,bridge_name='br-int',has_traffic_filtering=True,id=ab43788f-b69c-451f-ae7c-7bd41aca36a7,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab43788f-b6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'pci_devices' on Instance uuid d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:57:33 user nova-compute[75734]:   <uuid>d17ec0bc-ab9f-4127-b22c-2023ff1c0e30</uuid>
Nov 22 15:57:33 user nova-compute[75734]:   <name>instance-0000000e</name>
Nov 22 15:57:33 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:57:33 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:57:33 user nova-compute[75734]:   <metadata>
Nov 22 15:57:33 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:57:33 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:57:33 user nova-compute[75734]:       <nova:name>tempest-TestStampPattern-server-169801306</nova:name>
Nov 22 15:57:33 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:57:33</nova:creationTime>
Nov 22 15:57:33 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:57:33 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:57:33 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:57:33 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:57:33 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:57:33 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:57:33 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:57:33 user nova-compute[75734]:       <nova:owner>
Nov 22 15:57:33 user nova-compute[75734]:         <nova:user uuid="9c080eee08c34b80ae54aa0ed9893c4c">tempest-TestStampPattern-2140441883-project-member</nova:user>
Nov 22 15:57:33 user nova-compute[75734]:         <nova:project uuid="8378dfb8a70149df8f2cb392ee80e44f">tempest-TestStampPattern-2140441883</nova:project>
Nov 22 15:57:33 user nova-compute[75734]:       </nova:owner>
Nov 22 15:57:33 user nova-compute[75734]:       <nova:root type="image" uuid="57efd17e-73d7-4e04-926d-c44542a2f48c"/>
Nov 22 15:57:33 user nova-compute[75734]:       <nova:ports>
Nov 22 15:57:33 user nova-compute[75734]:         <nova:port uuid="ab43788f-b69c-451f-ae7c-7bd41aca36a7">
Nov 22 15:57:33 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 15:57:33 user nova-compute[75734]:         </nova:port>
Nov 22 15:57:33 user nova-compute[75734]:       </nova:ports>
Nov 22 15:57:33 user nova-compute[75734]:     </nova:instance>
Nov 22 15:57:33 user nova-compute[75734]:   </metadata>
Nov 22 15:57:33 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:57:33 user nova-compute[75734]:     <system>
Nov 22 15:57:33 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:57:33 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:57:33 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:57:33 user nova-compute[75734]:       <entry name="serial">d17ec0bc-ab9f-4127-b22c-2023ff1c0e30</entry>
Nov 22 15:57:33 user nova-compute[75734]:       <entry name="uuid">d17ec0bc-ab9f-4127-b22c-2023ff1c0e30</entry>
Nov 22 15:57:33 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:57:33 user nova-compute[75734]:     </system>
Nov 22 15:57:33 user nova-compute[75734]:   </sysinfo>
Nov 22 15:57:33 user nova-compute[75734]:   <os>
Nov 22 15:57:33 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:57:33 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:57:33 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:57:33 user nova-compute[75734]:   </os>
Nov 22 15:57:33 user nova-compute[75734]:   <features>
Nov 22 15:57:33 user nova-compute[75734]:     <acpi/>
Nov 22 15:57:33 user nova-compute[75734]:     <apic/>
Nov 22 15:57:33 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:57:33 user nova-compute[75734]:   </features>
Nov 22 15:57:33 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:57:33 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:57:33 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:57:33 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:57:33 user nova-compute[75734]:   </clock>
Nov 22 15:57:33 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:57:33 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:57:33 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:57:33 user nova-compute[75734]:   </cpu>
Nov 22 15:57:33 user nova-compute[75734]:   <devices>
Nov 22 15:57:33 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:57:33 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:57:33 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk"/>
Nov 22 15:57:33 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:57:33 user nova-compute[75734]:     </disk>
Nov 22 15:57:33 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:57:33 user nova-compute[75734]:       <mac address="fa:16:3e:88:39:b0"/>
Nov 22 15:57:33 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:33 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:57:33 user nova-compute[75734]:       <target dev="tapab43788f-b6"/>
Nov 22 15:57:33 user nova-compute[75734]:     </interface>
Nov 22 15:57:33 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:57:33 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/console.log" append="off"/>
Nov 22 15:57:33 user nova-compute[75734]:     </serial>
Nov 22 15:57:33 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:57:33 user nova-compute[75734]:     <video>
Nov 22 15:57:33 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:33 user nova-compute[75734]:     </video>
Nov 22 15:57:33 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:57:33 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:57:33 user nova-compute[75734]:     </rng>
Nov 22 15:57:33 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:57:33 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:57:33 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:57:33 user nova-compute[75734]:     </memballoon>
Nov 22 15:57:33 user nova-compute[75734]:   </devices>
Nov 22 15:57:33 user nova-compute[75734]: </domain>
Nov 22 15:57:33 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-169801306',display_name='tempest-TestStampPattern-server-169801306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-169801306',id=14,image_ref='57efd17e-73d7-4e04-926d-c44542a2f48c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr2F0xWX4V7cn83ISOfWR0ZWxAnt6203RwWMULSxvl2kcpmW50rLf6b1v+ZQY/JOZAnLEv+bGDYOSPNFyXR/xFl+3u2Yo1jVj5aBO/pRMHr8SQlBV/9R2tVPWk55zdVYA==',key_name='tempest-TestStampPattern-1711431298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8378dfb8a70149df8f2cb392ee80e44f',ramdisk_id='',reservation_id='r-mhnf0dwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3',image_min_disk='1',image_min_ram='0',image_owner_id='8378dfb8a70149df8f2cb392ee80e44f',image_owner_project_name='tempest-TestStampPattern-2140441883',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2140441883-project-member',image_user_id='9c080eee08c34b80ae54aa0ed9893c4c',network_allocated='True',owner_project_name='tempest-TestStampPattern-2140441883',owner_user_name='tempest-TestStampPattern-2140441883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:57:31Z,user_data=None,user_id='9c080eee08c34b80ae54aa0ed9893c4c',uuid=d17ec0bc-ab9f-4127-b22c-2023ff1c0e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converting VIF {"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:39:b0,bridge_name='br-int',has_traffic_filtering=True,id=ab43788f-b69c-451f-ae7c-7bd41aca36a7,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab43788f-b6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG os_vif [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:39:b0,bridge_name='br-int',has_traffic_filtering=True,id=ab43788f-b69c-451f-ae7c-7bd41aca36a7,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab43788f-b6') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '049b9faf-d6f8-5172-b24f-cd9a333bd1d7', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab43788f-b6, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab43788f-b6, col_values=(('qos', UUID('3b5b1a40-8c8c-4122-b1c1-f3d3fb7cd9dc')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab43788f-b6, col_values=(('external_ids', {'iface-id': 'ab43788f-b69c-451f-ae7c-7bd41aca36a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:39:b0', 'vm-uuid': 'd17ec0bc-ab9f-4127-b22c-2023ff1c0e30'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:57:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:34 user nova-compute[75734]: INFO os_vif [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:39:b0,bridge_name='br-int',has_traffic_filtering=True,id=ab43788f-b69c-451f-ae7c-7bd41aca36a7,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab43788f-b6')
Nov 22 15:57:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:57:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No VIF found with MAC fa:16:3e:88:39:b0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:57:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updated VIF entry in instance network info cache for port ab43788f-b69c-451f-ae7c-7bd41aca36a7. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:57:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updating instance_info_cache with network_info: [{"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:57:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66526508-4ef4-4e77-9ed4-c61842ecfd9a req-42eda02d-44d9-4252-a962-b4fc131af3c5 service nova] Releasing lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-82fe414c-2a4b-422e-b202-5a8da13e97d2 req-4f3aad02-b20f-4e9d-bd5b-70937dcdee5e service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-82fe414c-2a4b-422e-b202-5a8da13e97d2 req-4f3aad02-b20f-4e9d-bd5b-70937dcdee5e service nova] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-82fe414c-2a4b-422e-b202-5a8da13e97d2 req-4f3aad02-b20f-4e9d-bd5b-70937dcdee5e service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-82fe414c-2a4b-422e-b202-5a8da13e97d2 req-4f3aad02-b20f-4e9d-bd5b-70937dcdee5e service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-82fe414c-2a4b-422e-b202-5a8da13e97d2 req-4f3aad02-b20f-4e9d-bd5b-70937dcdee5e service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] No waiting events found dispatching network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:35 user nova-compute[75734]: WARNING nova.compute.manager [req-82fe414c-2a4b-422e-b202-5a8da13e97d2 req-4f3aad02-b20f-4e9d-bd5b-70937dcdee5e service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received unexpected event network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 for instance with vm_state building and task_state spawning.
Nov 22 15:57:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:37 user nova-compute[75734]: INFO nova.compute.manager [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Rescuing
Nov 22 15:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-830c81a3-c1e4-4a90-a9fb-b5c525ad93c0 req-e8143170-fbed-4501-b146-cca4d697a23c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-830c81a3-c1e4-4a90-a9fb-b5c525ad93c0 req-e8143170-fbed-4501-b146-cca4d697a23c service nova] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-830c81a3-c1e4-4a90-a9fb-b5c525ad93c0 req-e8143170-fbed-4501-b146-cca4d697a23c service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-830c81a3-c1e4-4a90-a9fb-b5c525ad93c0 req-e8143170-fbed-4501-b146-cca4d697a23c service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-830c81a3-c1e4-4a90-a9fb-b5c525ad93c0 req-e8143170-fbed-4501-b146-cca4d697a23c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] No waiting events found dispatching network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:37 user nova-compute[75734]: WARNING nova.compute.manager [req-830c81a3-c1e4-4a90-a9fb-b5c525ad93c0 req-e8143170-fbed-4501-b146-cca4d697a23c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received unexpected event network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 for instance with vm_state building and task_state spawning.
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:57:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Instance spawned successfully.
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:57:37 user nova-compute[75734]: INFO nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:57:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: INFO nova.compute.manager [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Took 7.30 seconds to build instance.
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21d73368-a882-494e-bb41-39178e49a378 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.531s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-eaff4205-5557-4d19-8709-ed21bc419711 req-1d587661-f337-4333-a11c-817e1721ab54 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eaff4205-5557-4d19-8709-ed21bc419711 req-1d587661-f337-4333-a11c-817e1721ab54 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eaff4205-5557-4d19-8709-ed21bc419711 req-1d587661-f337-4333-a11c-817e1721ab54 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eaff4205-5557-4d19-8709-ed21bc419711 req-1d587661-f337-4333-a11c-817e1721ab54 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-eaff4205-5557-4d19-8709-ed21bc419711 req-1d587661-f337-4333-a11c-817e1721ab54 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:38 user nova-compute[75734]: WARNING nova.compute.manager [req-eaff4205-5557-4d19-8709-ed21bc419711 req-1d587661-f337-4333-a11c-817e1721ab54 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance destroyed successfully.
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Attempting rescue
Nov 22 15:57:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75734) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 15:57:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Creating image(s)
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'trusted_certs' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.225s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue" returned: 0 in 0.069s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'migration_context' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.base [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<ee07b591-af40-4c95-9d6a-1ffc82eff086> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Start _get_guest_xml network_info=[{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:99:73:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'resources' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.base [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<ee07b591-af40-4c95-9d6a-1ffc82eff086> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'numa_topology' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.base [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<ee07b591-af40-4c95-9d6a-1ffc82eff086> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.base [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<ee07b591-af40-4c95-9d6a-1ffc82eff086> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-124882235',display_name='tempest-ServerRescueNegativeTestJSON-server-124882235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-124882235',id=1,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-dn9irsps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:53:14Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=ee07b591-af40-4c95-9d6a-1ffc82eff086,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:99:73:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:99:73:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'pci_devices' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.objects.base [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<ee07b591-af40-4c95-9d6a-1ffc82eff086> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:57:39 user nova-compute[75734]:   <uuid>ee07b591-af40-4c95-9d6a-1ffc82eff086</uuid>
Nov 22 15:57:39 user nova-compute[75734]:   <name>instance-00000001</name>
Nov 22 15:57:39 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:57:39 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:57:39 user nova-compute[75734]:   <metadata>
Nov 22 15:57:39 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:57:39 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:57:39 user nova-compute[75734]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-124882235</nova:name>
Nov 22 15:57:39 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:57:39</nova:creationTime>
Nov 22 15:57:39 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:57:39 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:57:39 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:57:39 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:57:39 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:57:39 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:57:39 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:57:39 user nova-compute[75734]:       <nova:owner>
Nov 22 15:57:39 user nova-compute[75734]:         <nova:user uuid="ea603e7c80014f17a76fec19b54443c9">tempest-ServerRescueNegativeTestJSON-970419785-project-member</nova:user>
Nov 22 15:57:39 user nova-compute[75734]:         <nova:project uuid="963ad36880484ed59f2b34c64a6e450e">tempest-ServerRescueNegativeTestJSON-970419785</nova:project>
Nov 22 15:57:39 user nova-compute[75734]:       </nova:owner>
Nov 22 15:57:39 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:57:39 user nova-compute[75734]:       <nova:ports>
Nov 22 15:57:39 user nova-compute[75734]:         <nova:port uuid="e1881bde-e537-452d-b9f1-697dd0638465">
Nov 22 15:57:39 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 15:57:39 user nova-compute[75734]:         </nova:port>
Nov 22 15:57:39 user nova-compute[75734]:       </nova:ports>
Nov 22 15:57:39 user nova-compute[75734]:     </nova:instance>
Nov 22 15:57:39 user nova-compute[75734]:   </metadata>
Nov 22 15:57:39 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:57:39 user nova-compute[75734]:     <system>
Nov 22 15:57:39 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:57:39 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:57:39 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:57:39 user nova-compute[75734]:       <entry name="serial">ee07b591-af40-4c95-9d6a-1ffc82eff086</entry>
Nov 22 15:57:39 user nova-compute[75734]:       <entry name="uuid">ee07b591-af40-4c95-9d6a-1ffc82eff086</entry>
Nov 22 15:57:39 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:57:39 user nova-compute[75734]:     </system>
Nov 22 15:57:39 user nova-compute[75734]:   </sysinfo>
Nov 22 15:57:39 user nova-compute[75734]:   <os>
Nov 22 15:57:39 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:57:39 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:57:39 user nova-compute[75734]:   </os>
Nov 22 15:57:39 user nova-compute[75734]:   <features>
Nov 22 15:57:39 user nova-compute[75734]:     <acpi/>
Nov 22 15:57:39 user nova-compute[75734]:     <apic/>
Nov 22 15:57:39 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:57:39 user nova-compute[75734]:   </features>
Nov 22 15:57:39 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:57:39 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:57:39 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:57:39 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:57:39 user nova-compute[75734]:   </clock>
Nov 22 15:57:39 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:57:39 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:57:39 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:57:39 user nova-compute[75734]:   </cpu>
Nov 22 15:57:39 user nova-compute[75734]:   <devices>
Nov 22 15:57:39 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:57:39 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:57:39 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue"/>
Nov 22 15:57:39 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:57:39 user nova-compute[75734]:     </disk>
Nov 22 15:57:39 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:57:39 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:57:39 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk"/>
Nov 22 15:57:39 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 15:57:39 user nova-compute[75734]:     </disk>
Nov 22 15:57:39 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:57:39 user nova-compute[75734]:       <mac address="fa:16:3e:99:73:52"/>
Nov 22 15:57:39 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:39 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:57:39 user nova-compute[75734]:       <target dev="tape1881bde-e5"/>
Nov 22 15:57:39 user nova-compute[75734]:     </interface>
Nov 22 15:57:39 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:57:39 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/console.log" append="off"/>
Nov 22 15:57:39 user nova-compute[75734]:     </serial>
Nov 22 15:57:39 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:57:39 user nova-compute[75734]:     <video>
Nov 22 15:57:39 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:39 user nova-compute[75734]:     </video>
Nov 22 15:57:39 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:57:39 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:57:39 user nova-compute[75734]:     </rng>
Nov 22 15:57:39 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:57:39 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:57:39 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:57:39 user nova-compute[75734]:     </memballoon>
Nov 22 15:57:39 user nova-compute[75734]:   </devices>
Nov 22 15:57:39 user nova-compute[75734]: </domain>
Nov 22 15:57:39 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:39 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance destroyed successfully.
Nov 22 15:57:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:57:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No VIF found with MAC fa:16:3e:99:73:52, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:40 user nova-compute[75734]: WARNING nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:40 user nova-compute[75734]: WARNING nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:40 user nova-compute[75734]: WARNING nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:40 user nova-compute[75734]: WARNING nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:40 user nova-compute[75734]: WARNING nova.compute.manager [req-b783e819-9d08-4abb-a26c-cc3ba48241d8 req-917bfa3c-324d-4843-9505-a5287f4858f7 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:42 user nova-compute[75734]: WARNING nova.compute.manager [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:42 user nova-compute[75734]: WARNING nova.compute.manager [req-2223a9f3-3a6e-4556-ba5f-c70140f4deb7 req-60c10345-9d1b-4025-b5f7-e0e3089d69ea service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1db4dd6c-79d1-499e-9ad7-74e7d2586c3d tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json" returned: 0 in 0.324s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:49 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:49 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8076MB free_disk=25.219932556152344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9fb1125f-ce45-4cb6-83a0-d90e92f2569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:57:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:57:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:57:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:54 user nova-compute[75734]: INFO nova.compute.manager [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Rescuing
Nov 22 15:57:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating instance_info_cache with network_info: [{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:57:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:57:55 user nova-compute[75734]: INFO nova.compute.claims [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Claim successful on node user
Nov 22 15:57:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-38b98209-8842-4bee-812d-beea0b687f1a req-6354fe1f-795b-4020-968a-b45e792ede64 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-38b98209-8842-4bee-812d-beea0b687f1a req-6354fe1f-795b-4020-968a-b45e792ede64 service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-38b98209-8842-4bee-812d-beea0b687f1a req-6354fe1f-795b-4020-968a-b45e792ede64 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-38b98209-8842-4bee-812d-beea0b687f1a req-6354fe1f-795b-4020-968a-b45e792ede64 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-38b98209-8842-4bee-812d-beea0b687f1a req-6354fe1f-795b-4020-968a-b45e792ede64 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:55 user nova-compute[75734]: WARNING nova.compute.manager [req-38b98209-8842-4bee-812d-beea0b687f1a req-6354fe1f-795b-4020-968a-b45e792ede64 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance destroyed successfully.
Nov 22 15:57:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Attempting a stable device rescue
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75734) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.network.neutron [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 15:57:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Creating image(s)
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "/opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'trusted_certs' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "05fdb74f8165e5abf3fa833965cd3af4ce00baac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "05fdb74f8165e5abf3fa833965cd3af4ce00baac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:57:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Creating image(s)
Nov 22 15:57:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "/opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "/opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "/opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "fbed974025dbee69cdd5b93d001ad7e033f0edd7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "fbed974025dbee69cdd5b93d001ad7e033f0edd7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:56 user nova-compute[75734]: DEBUG nova.policy [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa239ed83f2a4634b9a5ed3629b6e1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f76c06e71a947e7a25edf5c46ee6779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.part --force-share --output=json" returned: 0 in 0.713s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG nova.virt.images [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] 340d823b-3ef1-43b2-b041-9d22241ff6bf was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.part /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-d8f5c013-26f4-4bf5-8d1a-635587f2701b req-a61e9879-d87e-47f9-9321-fa0a61e640bf service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d8f5c013-26f4-4bf5-8d1a-635587f2701b req-a61e9879-d87e-47f9-9321-fa0a61e640bf service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d8f5c013-26f4-4bf5-8d1a-635587f2701b req-a61e9879-d87e-47f9-9321-fa0a61e640bf service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d8f5c013-26f4-4bf5-8d1a-635587f2701b req-a61e9879-d87e-47f9-9321-fa0a61e640bf service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-d8f5c013-26f4-4bf5-8d1a-635587f2701b req-a61e9879-d87e-47f9-9321-fa0a61e640bf service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:57:57 user nova-compute[75734]: WARNING nova.compute.manager [req-d8f5c013-26f4-4bf5-8d1a-635587f2701b req-a61e9879-d87e-47f9-9321-fa0a61e640bf service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state rescuing.
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG nova.virt.images [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] db2b9fc8-0506-47dd-8bcb-3511aba7f702 was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.part /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.part /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.converted" returned: 0 in 0.566s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.part /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.converted" returned: 0 in 0.634s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "05fdb74f8165e5abf3fa833965cd3af4ce00baac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.550s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "05fdb74f8165e5abf3fa833965cd3af4ce00baac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "05fdb74f8165e5abf3fa833965cd3af4ce00baac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "fbed974025dbee69cdd5b93d001ad7e033f0edd7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.592s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac --force-share --output=json" returned: 0 in 0.240s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac,backing_fmt=raw /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.rescue {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.network.neutron [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Successfully created port: 644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac,backing_fmt=raw /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.rescue" returned: 0 in 0.060s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "05fdb74f8165e5abf3fa833965cd3af4ce00baac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'migration_context' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<635ef0b9-e96c-4d0d-8f62-4382ad2813b8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Start _get_guest_xml network_info=[{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "vif_mac": "fa:16:3e:30:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '340d823b-3ef1-43b2-b041-9d22241ff6bf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a13e0219-26e3-4b1f-bd17-4621ae7a9cc9', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNtumXRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '635ef0b9-e96c-4d0d-8f62-4382ad2813b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0823898-f136-4505-8853-c6cb928e2ecf', 'serial': 'b0823898-f136-4505-8853-c6cb928e2ecf'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'resources' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<635ef0b9-e96c-4d0d-8f62-4382ad2813b8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'numa_topology' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7 --force-share --output=json" returned: 0 in 0.219s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "fbed974025dbee69cdd5b93d001ad7e033f0edd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "fbed974025dbee69cdd5b93d001ad7e033f0edd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<635ef0b9-e96c-4d0d-8f62-4382ad2813b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'vcpu_model' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.objects.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<635ef0b9-e96c-4d0d-8f62-4382ad2813b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNtumXRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:57:58 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:57:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:57:58 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:57:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:57:58 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7 --force-share --output=json" returned: 0 in 0.214s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7,backing_fmt=raw /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c9aa70-6274-4a8b-97de-a1f14df83251]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iNtumXRZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 15:57:58 user nova-compute[75734]: node.name = iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 15:57:58 user nova-compute[75734]: node.tpgt = -1
Nov 22 15:57:58 user nova-compute[75734]: node.startup = automatic
Nov 22 15:57:58 user nova-compute[75734]: node.leading_login = No
Nov 22 15:57:58 user nova-compute[75734]: iface.iscsi_ifacename = default
Nov 22 15:57:58 user nova-compute[75734]: iface.net_ifacename = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.ipaddress = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.prefix_len = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.hwaddress = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.transport_name = tcp
Nov 22 15:57:58 user nova-compute[75734]: iface.initiatorname = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.state = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.vlan_id = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.vlan_priority = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.vlan_state = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.iface_num = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.mtu = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.port = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.bootproto = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.subnet_mask = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.gateway = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_alt_client_id = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_dns = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_learn_iqn = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_vendor_id_state = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_vendor_id = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.dhcp_slp_da = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.fragmentation = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.gratuitous_arp = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.incoming_forwarding = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.tos_state = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.tos = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.ttl = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.delayed_ack = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.tcp_nagle = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.tcp_wsf_state = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.tcp_wsf = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.tcp_timer_scale = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.tcp_timestamp = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.redirect = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.def_task_mgmt_timeout = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.header_digest = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.data_digest = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.immediate_data = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.initial_r2t = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.data_seq_inorder = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.data_pdu_inorder = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.erl = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.max_receive_data_len = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.first_burst_len = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.max_outstanding_r2t = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.max_burst_len = 0
Nov 22 15:57:58 user nova-compute[75734]: iface.chap_auth = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.bidi_chap = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.strict_login_compliance = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.discovery_auth = <empty>
Nov 22 15:57:58 user nova-compute[75734]: iface.discovery_logout = <empty>
Nov 22 15:57:58 user nova-compute[75734]: node.discovery_address = <empty>
Nov 22 15:57:58 user nova-compute[75734]: node.discovery_port = 0
Nov 22 15:57:58 user nova-compute[75734]: node.discovery_type = static
Nov 22 15:57:58 user nova-compute[75734]: node.session.initial_cmdsn = 0
Nov 22 15:57:58 user nova-compute[75734]: node.session.initial_login_retry_max = 8
Nov 22 15:57:58 user nova-compute[75734]: node.session.xmit_thread_priority = -20
Nov 22 15:57:58 user nova-compute[75734]: node.session.cmds_max = 128
Nov 22 15:57:58 user nova-compute[75734]: node.session.queue_depth = 32
Nov 22 15:57:58 user nova-compute[75734]: node.session.nr_sessions = 1
Nov 22 15:57:58 user nova-compute[75734]: node.session.auth.authmethod = CHAP
Nov 22 15:57:58 user nova-compute[75734]: node.session.auth.username = iNtumXRZ
Nov 22 15:57:58 user nova-compute[75734]: node.session.auth.password = ***
Nov 22 15:57:58 user nova-compute[75734]: node.session.auth.username_in = <empty>
Nov 22 15:57:58 user nova-compute[75734]: node.session.auth.password_in = <empty>
Nov 22 15:57:58 user nova-compute[75734]: node.session.auth.chap_algs = MD5
Nov 22 15:57:58 user nova-compute[75734]: node.session.timeo.replacement_timeout = 120
Nov 22 15:57:58 user nova-compute[75734]: node.session.err_timeo.abort_timeout = 15
Nov 22 15:57:58 user nova-compute[75734]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 15:57:58 user nova-compute[75734]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 15:57:58 user nova-compute[75734]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.FastAbort = Yes
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.InitialR2T = No
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.ImmediateData = Yes
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.MaxConnections = 1
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 15:57:58 user nova-compute[75734]: node.session.iscsi.ERL = 0
Nov 22 15:57:58 user nova-compute[75734]: node.session.scan = manual
Nov 22 15:57:58 user nova-compute[75734]: node.session.reopen_max = 0
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].address = 172.16.0.220
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].port = 3260
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].startup = manual
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].tcp.window_size = 524288
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].tcp.type_of_service = 0
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].timeo.logout_timeout = 15
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].timeo.login_timeout = 15
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].timeo.auth_timeout = 45
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].iscsi.DataDigest = None
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].iscsi.IFMarker = No
Nov 22 15:57:58 user nova-compute[75734]: node.conn[0].iscsi.OFMarker = No
Nov 22 15:57:58 user nova-compute[75734]: # END RECORD
Nov 22 15:57:58 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7,backing_fmt=raw /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk 1073741824" returned: 0 in 0.049s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "fbed974025dbee69cdd5b93d001ad7e033f0edd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f4110d-3f96-4e31-87f6-43e5e36ec4cd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8f57a1-b6d5-4995-ae07-762914317702]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNtumXRZ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNtumXRZ" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf2b15-62a4-4d64-953f-e127b7044f70]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNtumXRZ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad879354-70fc-47a9-8cb3-f512c5e188bc]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a709de-21fe-4838-ab88-94ce581ee042]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:57:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:57:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] HCTL ('35', '0', '0', 0) found on session 17 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2b684-f5c8-43b7-9e42-e21e7588f269]: (4, ('0 0 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching for a device in session 17 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNtumXRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.259s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== connect_volume: return (261ms) {'type': 'block', 'scsi_wwn': '26266386531353234', 'path': '/dev/sdd'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266386531353234', 'path': '/dev/sdd'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7 --force-share --output=json" returned: 0 in 0.227s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-625597841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-625597841',id=11,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:56:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-1zztwyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:56:23Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=635ef0b9-e96c-4d0d-8f62-4382ad2813b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "vif_mac": "fa:16:3e:30:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "vif_mac": "fa:16:3e:30:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'pci_devices' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.objects.base [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<635ef0b9-e96c-4d0d-8f62-4382ad2813b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:57:59 user nova-compute[75734]:   <uuid>635ef0b9-e96c-4d0d-8f62-4382ad2813b8</uuid>
Nov 22 15:57:59 user nova-compute[75734]:   <name>instance-0000000b</name>
Nov 22 15:57:59 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:57:59 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:57:59 user nova-compute[75734]:   <metadata>
Nov 22 15:57:59 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:57:59 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:57:59 user nova-compute[75734]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-625597841</nova:name>
Nov 22 15:57:59 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:57:58</nova:creationTime>
Nov 22 15:57:59 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:57:59 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:57:59 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:57:59 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:57:59 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:57:59 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:57:59 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:57:59 user nova-compute[75734]:       <nova:owner>
Nov 22 15:57:59 user nova-compute[75734]:         <nova:user uuid="5dc99ff4c7054545a10673afb2cf930b">tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member</nova:user>
Nov 22 15:57:59 user nova-compute[75734]:         <nova:project uuid="234cf12714b74b12aa027c8fff2e784e">tempest-ServerBootFromVolumeStableRescueTest-1333150873</nova:project>
Nov 22 15:57:59 user nova-compute[75734]:       </nova:owner>
Nov 22 15:57:59 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:57:59 user nova-compute[75734]:       <nova:ports>
Nov 22 15:57:59 user nova-compute[75734]:         <nova:port uuid="f2745d29-485b-4942-afe7-cbfe620d3938">
Nov 22 15:57:59 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 15:57:59 user nova-compute[75734]:         </nova:port>
Nov 22 15:57:59 user nova-compute[75734]:       </nova:ports>
Nov 22 15:57:59 user nova-compute[75734]:     </nova:instance>
Nov 22 15:57:59 user nova-compute[75734]:   </metadata>
Nov 22 15:57:59 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:57:59 user nova-compute[75734]:     <system>
Nov 22 15:57:59 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:57:59 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:57:59 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:57:59 user nova-compute[75734]:       <entry name="serial">635ef0b9-e96c-4d0d-8f62-4382ad2813b8</entry>
Nov 22 15:57:59 user nova-compute[75734]:       <entry name="uuid">635ef0b9-e96c-4d0d-8f62-4382ad2813b8</entry>
Nov 22 15:57:59 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:57:59 user nova-compute[75734]:     </system>
Nov 22 15:57:59 user nova-compute[75734]:   </sysinfo>
Nov 22 15:57:59 user nova-compute[75734]:   <os>
Nov 22 15:57:59 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:57:59 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:57:59 user nova-compute[75734]:   </os>
Nov 22 15:57:59 user nova-compute[75734]:   <features>
Nov 22 15:57:59 user nova-compute[75734]:     <acpi/>
Nov 22 15:57:59 user nova-compute[75734]:     <apic/>
Nov 22 15:57:59 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:57:59 user nova-compute[75734]:   </features>
Nov 22 15:57:59 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:57:59 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:57:59 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:57:59 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:57:59 user nova-compute[75734]:   </clock>
Nov 22 15:57:59 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:57:59 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:57:59 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:57:59 user nova-compute[75734]:   </cpu>
Nov 22 15:57:59 user nova-compute[75734]:   <devices>
Nov 22 15:57:59 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 15:57:59 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:57:59 user nova-compute[75734]:       <source dev="/dev/sdd"/>
Nov 22 15:57:59 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:57:59 user nova-compute[75734]:       <serial>b0823898-f136-4505-8853-c6cb928e2ecf</serial>
Nov 22 15:57:59 user nova-compute[75734]:     </disk>
Nov 22 15:57:59 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:57:59 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:57:59 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.rescue"/>
Nov 22 15:57:59 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 15:57:59 user nova-compute[75734]:       <boot order="1"/>
Nov 22 15:57:59 user nova-compute[75734]:     </disk>
Nov 22 15:57:59 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:57:59 user nova-compute[75734]:       <mac address="fa:16:3e:30:76:b0"/>
Nov 22 15:57:59 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:59 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:57:59 user nova-compute[75734]:       <target dev="tapf2745d29-48"/>
Nov 22 15:57:59 user nova-compute[75734]:     </interface>
Nov 22 15:57:59 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:57:59 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/console.log" append="off"/>
Nov 22 15:57:59 user nova-compute[75734]:     </serial>
Nov 22 15:57:59 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:57:59 user nova-compute[75734]:     <video>
Nov 22 15:57:59 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:57:59 user nova-compute[75734]:     </video>
Nov 22 15:57:59 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:57:59 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:57:59 user nova-compute[75734]:     </rng>
Nov 22 15:57:59 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:57:59 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:57:59 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:57:59 user nova-compute[75734]:     </memballoon>
Nov 22 15:57:59 user nova-compute[75734]:   </devices>
Nov 22 15:57:59 user nova-compute[75734]: </domain>
Nov 22 15:57:59 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:57:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance destroyed successfully.
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No VIF found with MAC fa:16:3e:30:76:b0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Cannot resize image /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Ensure instance console log exists: /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Successfully updated port: 644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquired lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-changed-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Refreshing instance network info cache due to event network-changed-644b0c65-974c-4b94-a274-cda3a95eb66e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] Acquiring lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:57:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Updating instance_info_cache with network_info: [{"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Releasing lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Instance network_info: |[{"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] Acquired lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.network.neutron [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Refreshing network info cache for port 644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Start _get_guest_xml network_info=[{"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:57:49Z,direct_url=<?>,disk_format='qcow2',id=db2b9fc8-0506-47dd-8bcb-3511aba7f702,min_disk=0,min_ram=0,name='',owner='beec5fbf96d042b1aa66711813cd9f64',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:57:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'encrypted': False, 'image_id': 'db2b9fc8-0506-47dd-8bcb-3511aba7f702'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:58:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:57:49Z,direct_url=<?>,disk_format='qcow2',id=db2b9fc8-0506-47dd-8bcb-3511aba7f702,min_disk=0,min_ram=0,name='',owner='beec5fbf96d042b1aa66711813cd9f64',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:57:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-209506314',display_name='tempest-AttachSCSIVolumeTestJSON-server-209506314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-209506314',id=15,image_ref='db2b9fc8-0506-47dd-8bcb-3511aba7f702',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl5+VmV+vK/W5Ik1UrPEl72Rd/+S1TTzD1Ow7RYJHeWWEgSkTuMd1CibCqhQYSo9jDUtzDPgUzaHv/4Tuj/1N1j3p2fgewS2SRjqEMcGGSFDUgk2bm8mlrE1cJAUR6qYw==',key_name='tempest-keypair-767241237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f76c06e71a947e7a25edf5c46ee6779',ramdisk_id='',reservation_id='r-a302xk90',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db2b9fc8-0506-47dd-8bcb-3511aba7f702',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-695499499',owner_user_name='tempest-AttachSCSIVolumeTestJSON-695499499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa239ed83f2a4634b9a5ed3629b6e1ec',uuid=95cb311e-9de3-4cf9-8885-aab0c627a9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Converting VIF {"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:1c:79,bridge_name='br-int',has_traffic_filtering=True,id=644b0c65-974c-4b94-a274-cda3a95eb66e,network=Network(e69939c6-b35d-403f-b131-7d9e21b968ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644b0c65-97') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lazy-loading 'pci_devices' on Instance uuid 95cb311e-9de3-4cf9-8885-aab0c627a9cd {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:58:00 user nova-compute[75734]:   <uuid>95cb311e-9de3-4cf9-8885-aab0c627a9cd</uuid>
Nov 22 15:58:00 user nova-compute[75734]:   <name>instance-0000000f</name>
Nov 22 15:58:00 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:58:00 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:58:00 user nova-compute[75734]:   <metadata>
Nov 22 15:58:00 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:58:00 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:58:00 user nova-compute[75734]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-209506314</nova:name>
Nov 22 15:58:00 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:58:00</nova:creationTime>
Nov 22 15:58:00 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:58:00 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:58:00 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:58:00 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:58:00 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:58:00 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:58:00 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:58:00 user nova-compute[75734]:       <nova:owner>
Nov 22 15:58:00 user nova-compute[75734]:         <nova:user uuid="fa239ed83f2a4634b9a5ed3629b6e1ec">tempest-AttachSCSIVolumeTestJSON-695499499-project-member</nova:user>
Nov 22 15:58:00 user nova-compute[75734]:         <nova:project uuid="6f76c06e71a947e7a25edf5c46ee6779">tempest-AttachSCSIVolumeTestJSON-695499499</nova:project>
Nov 22 15:58:00 user nova-compute[75734]:       </nova:owner>
Nov 22 15:58:00 user nova-compute[75734]:       <nova:root type="image" uuid="db2b9fc8-0506-47dd-8bcb-3511aba7f702"/>
Nov 22 15:58:00 user nova-compute[75734]:       <nova:ports>
Nov 22 15:58:00 user nova-compute[75734]:         <nova:port uuid="644b0c65-974c-4b94-a274-cda3a95eb66e">
Nov 22 15:58:00 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 15:58:00 user nova-compute[75734]:         </nova:port>
Nov 22 15:58:00 user nova-compute[75734]:       </nova:ports>
Nov 22 15:58:00 user nova-compute[75734]:     </nova:instance>
Nov 22 15:58:00 user nova-compute[75734]:   </metadata>
Nov 22 15:58:00 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:58:00 user nova-compute[75734]:     <system>
Nov 22 15:58:00 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:58:00 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:58:00 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:58:00 user nova-compute[75734]:       <entry name="serial">95cb311e-9de3-4cf9-8885-aab0c627a9cd</entry>
Nov 22 15:58:00 user nova-compute[75734]:       <entry name="uuid">95cb311e-9de3-4cf9-8885-aab0c627a9cd</entry>
Nov 22 15:58:00 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:58:00 user nova-compute[75734]:     </system>
Nov 22 15:58:00 user nova-compute[75734]:   </sysinfo>
Nov 22 15:58:00 user nova-compute[75734]:   <os>
Nov 22 15:58:00 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:58:00 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:58:00 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:58:00 user nova-compute[75734]:   </os>
Nov 22 15:58:00 user nova-compute[75734]:   <features>
Nov 22 15:58:00 user nova-compute[75734]:     <acpi/>
Nov 22 15:58:00 user nova-compute[75734]:     <apic/>
Nov 22 15:58:00 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:58:00 user nova-compute[75734]:   </features>
Nov 22 15:58:00 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:58:00 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:58:00 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:58:00 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:58:00 user nova-compute[75734]:   </clock>
Nov 22 15:58:00 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:58:00 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:58:00 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:58:00 user nova-compute[75734]:   </cpu>
Nov 22 15:58:00 user nova-compute[75734]:   <devices>
Nov 22 15:58:00 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:58:00 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:58:00 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk"/>
Nov 22 15:58:00 user nova-compute[75734]:       <target dev="sda" bus="scsi"/>
Nov 22 15:58:00 user nova-compute[75734]:       <address type="drive" controller="0" unit="0"/>
Nov 22 15:58:00 user nova-compute[75734]:     </disk>
Nov 22 15:58:00 user nova-compute[75734]:     <disk type="file" device="cdrom">
Nov 22 15:58:00 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 15:58:00 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk.config"/>
Nov 22 15:58:00 user nova-compute[75734]:       <target dev="sdb" bus="scsi"/>
Nov 22 15:58:00 user nova-compute[75734]:       <address type="drive" controller="0" unit="1"/>
Nov 22 15:58:00 user nova-compute[75734]:     </disk>
Nov 22 15:58:00 user nova-compute[75734]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 22 15:58:00 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:58:00 user nova-compute[75734]:       <mac address="fa:16:3e:95:1c:79"/>
Nov 22 15:58:00 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:58:00 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:58:00 user nova-compute[75734]:       <target dev="tap644b0c65-97"/>
Nov 22 15:58:00 user nova-compute[75734]:     </interface>
Nov 22 15:58:00 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:58:00 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/console.log" append="off"/>
Nov 22 15:58:00 user nova-compute[75734]:     </serial>
Nov 22 15:58:00 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:58:00 user nova-compute[75734]:     <video>
Nov 22 15:58:00 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:58:00 user nova-compute[75734]:     </video>
Nov 22 15:58:00 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:58:00 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:58:00 user nova-compute[75734]:     </rng>
Nov 22 15:58:00 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:58:00 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:58:00 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:58:00 user nova-compute[75734]:     </memballoon>
Nov 22 15:58:00 user nova-compute[75734]:   </devices>
Nov 22 15:58:00 user nova-compute[75734]: </domain>
Nov 22 15:58:00 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-209506314',display_name='tempest-AttachSCSIVolumeTestJSON-server-209506314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-209506314',id=15,image_ref='db2b9fc8-0506-47dd-8bcb-3511aba7f702',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl5+VmV+vK/W5Ik1UrPEl72Rd/+S1TTzD1Ow7RYJHeWWEgSkTuMd1CibCqhQYSo9jDUtzDPgUzaHv/4Tuj/1N1j3p2fgewS2SRjqEMcGGSFDUgk2bm8mlrE1cJAUR6qYw==',key_name='tempest-keypair-767241237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f76c06e71a947e7a25edf5c46ee6779',ramdisk_id='',reservation_id='r-a302xk90',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db2b9fc8-0506-47dd-8bcb-3511aba7f702',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-695499499',owner_user_name='tempest-AttachSCSIVolumeTestJSON-695499499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa239ed83f2a4634b9a5ed3629b6e1ec',uuid=95cb311e-9de3-4cf9-8885-aab0c627a9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Converting VIF {"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:1c:79,bridge_name='br-int',has_traffic_filtering=True,id=644b0c65-974c-4b94-a274-cda3a95eb66e,network=Network(e69939c6-b35d-403f-b131-7d9e21b968ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644b0c65-97') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG os_vif [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:1c:79,bridge_name='br-int',has_traffic_filtering=True,id=644b0c65-974c-4b94-a274-cda3a95eb66e,network=Network(e69939c6-b35d-403f-b131-7d9e21b968ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644b0c65-97') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25bcb37f-f1b7-5251-bc5d-a27fe7390911', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap644b0c65-97, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap644b0c65-97, col_values=(('qos', UUID('0777b778-56c8-4b29-b3ca-dd9d494eb932')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap644b0c65-97, col_values=(('external_ids', {'iface-id': '644b0c65-974c-4b94-a274-cda3a95eb66e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:1c:79', 'vm-uuid': '95cb311e-9de3-4cf9-8885-aab0c627a9cd'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: INFO os_vif [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:1c:79,bridge_name='br-int',has_traffic_filtering=True,id=644b0c65-974c-4b94-a274-cda3a95eb66e,network=Network(e69939c6-b35d-403f-b131-7d9e21b968ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644b0c65-97')
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] No BDM found with device name sda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] No VIF found with MAC fa:16:3e:95:1c:79, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:58:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Using config drive
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Creating config drive at /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk.config
Nov 22 15:58:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe733zi5c {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-76e8d41f-71cf-4ab4-b79e-45406212588d req-e062933c-f850-48e2-a53f-5610539555c4 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76e8d41f-71cf-4ab4-b79e-45406212588d req-e062933c-f850-48e2-a53f-5610539555c4 service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76e8d41f-71cf-4ab4-b79e-45406212588d req-e062933c-f850-48e2-a53f-5610539555c4 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76e8d41f-71cf-4ab4-b79e-45406212588d req-e062933c-f850-48e2-a53f-5610539555c4 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-76e8d41f-71cf-4ab4-b79e-45406212588d req-e062933c-f850-48e2-a53f-5610539555c4 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:01 user nova-compute[75734]: WARNING nova.compute.manager [req-76e8d41f-71cf-4ab4-b79e-45406212588d req-e062933c-f850-48e2-a53f-5610539555c4 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state rescuing.
Nov 22 15:58:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe733zi5c" returned: 0 in 0.096s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Updated VIF entry in instance network info cache for port 644b0c65-974c-4b94-a274-cda3a95eb66e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Updating instance_info_cache with network_info: [{"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-452b7928-3b0f-45bd-83ac-14faa02c5406 req-6965ecd0-96d5-4435-bfe6-327658a961e2 service nova] Releasing lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:58:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:58:03 user nova-compute[75734]: INFO nova.compute.claims [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Claim successful on node user
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-6d50f762-43dd-4431-8122-2863fd02fa14 req-08cc768d-a3a0-49ba-92c8-f9f637c18ba7 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d50f762-43dd-4431-8122-2863fd02fa14 req-08cc768d-a3a0-49ba-92c8-f9f637c18ba7 service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d50f762-43dd-4431-8122-2863fd02fa14 req-08cc768d-a3a0-49ba-92c8-f9f637c18ba7 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d50f762-43dd-4431-8122-2863fd02fa14 req-08cc768d-a3a0-49ba-92c8-f9f637c18ba7 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-6d50f762-43dd-4431-8122-2863fd02fa14 req-08cc768d-a3a0-49ba-92c8-f9f637c18ba7 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:03 user nova-compute[75734]: WARNING nova.compute.manager [req-6d50f762-43dd-4431-8122-2863fd02fa14 req-08cc768d-a3a0-49ba-92c8-f9f637c18ba7 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state rescuing.
Nov 22 15:58:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:58:03 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.policy [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9891b862488466e8e46427bbd19f742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82865952d35349ffa829cf563d829fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:58:03 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Creating image(s)
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "/opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "/opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "/opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.196s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.227s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:04 user nova-compute[75734]: INFO nova.compute.manager [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Terminating instance
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk 1073741824" returned: 0 in 0.071s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.241s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a7ab5da6-98c0-42d1-ac5b-f2f15a1fc02a tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Cannot resize image /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Ensure instance console log exists: /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:05 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Instance destroyed successfully.
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.objects.instance [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lazy-loading 'resources' on Instance uuid 9fb1125f-ce45-4cb6-83a0-d90e92f2569a {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1351785811',display_name='tempest-VolumesAdminNegativeTest-server-1351785811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1351785811',id=12,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:56:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0495ec21f9b74a2e8d30e58d3ad504ff',ramdisk_id='',reservation_id='r-2cw8qen0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1651481107',owner_user_name='tempest-VolumesAdminNegativeTest-1651481107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:56:13Z,user_data=None,user_id='c3fc7f0844ed41488359c1dd43feeb66',uuid=9fb1125f-ce45-4cb6-83a0-d90e92f2569a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converting VIF {"id": "dda26afc-be95-4012-8949-0133f58eecdc", "address": "fa:16:3e:ee:4a:e2", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda26afc-be", "ovs_interfaceid": "dda26afc-be95-4012-8949-0133f58eecdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:4a:e2,bridge_name='br-int',has_traffic_filtering=True,id=dda26afc-be95-4012-8949-0133f58eecdc,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda26afc-be') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG os_vif [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:4a:e2,bridge_name='br-int',has_traffic_filtering=True,id=dda26afc-be95-4012-8949-0133f58eecdc,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda26afc-be') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdda26afc-be, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-23b1a856-984b-45ad-aafd-ce8e4b8c93a9 req-78d1df09-a385-4e2e-939a-cb5463ee1ba0 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-23b1a856-984b-45ad-aafd-ce8e4b8c93a9 req-78d1df09-a385-4e2e-939a-cb5463ee1ba0 service nova] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-23b1a856-984b-45ad-aafd-ce8e4b8c93a9 req-78d1df09-a385-4e2e-939a-cb5463ee1ba0 service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-23b1a856-984b-45ad-aafd-ce8e4b8c93a9 req-78d1df09-a385-4e2e-939a-cb5463ee1ba0 service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-23b1a856-984b-45ad-aafd-ce8e4b8c93a9 req-78d1df09-a385-4e2e-939a-cb5463ee1ba0 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] No waiting events found dispatching network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:05 user nova-compute[75734]: WARNING nova.compute.manager [req-23b1a856-984b-45ad-aafd-ce8e4b8c93a9 req-78d1df09-a385-4e2e-939a-cb5463ee1ba0 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received unexpected event network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e for instance with vm_state building and task_state spawning.
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa6fecab-842e-4702-b6a7-7e611024e86d) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:05 user nova-compute[75734]: INFO os_vif [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:4a:e2,bridge_name='br-int',has_traffic_filtering=True,id=dda26afc-be95-4012-8949-0133f58eecdc,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda26afc-be')
Nov 22 15:58:05 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Deleting instance files /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a_del
Nov 22 15:58:05 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Deletion of /opt/stack/data/nova/instances/9fb1125f-ce45-4cb6-83a0-d90e92f2569a_del complete
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received event network-vif-unplugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] Acquiring lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] No waiting events found dispatching network-vif-unplugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received event network-vif-unplugged-dda26afc-be95-4012-8949-0133f58eecdc for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received event network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] Acquiring lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] No waiting events found dispatching network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:05 user nova-compute[75734]: WARNING nova.compute.manager [req-751573bf-1b01-4994-9885-584c353fbd5a req-75de0f92-5fb0-4248-9ef0-db957f7894ee service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received unexpected event network-vif-plugged-dda26afc-be95-4012-8949-0133f58eecdc for instance with vm_state active and task_state deleting.
Nov 22 15:58:05 user nova-compute[75734]: INFO nova.compute.manager [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 22 15:58:05 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:58:05 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Instance spawned successfully.
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:06 user nova-compute[75734]: INFO nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Took 9.19 seconds to spawn the instance on the hypervisor.
Nov 22 15:58:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:58:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Successfully created port: 9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:58:06 user nova-compute[75734]: INFO nova.compute.manager [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Took 11.20 seconds to build instance.
Nov 22 15:58:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-725d3c02-bbaf-494d-8598-8dce7b6a2b04 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.311s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:06 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:06 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Took 1.15 seconds to deallocate network for instance.
Nov 22 15:58:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Successfully updated port: 9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:07 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Deleted allocations for instance 9fb1125f-ce45-4cb6-83a0-d90e92f2569a
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] No waiting events found dispatching network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:07 user nova-compute[75734]: WARNING nova.compute.manager [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received unexpected event network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e for instance with vm_state active and task_state None.
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: 9fb1125f-ce45-4cb6-83a0-d90e92f2569a] Received event network-vif-deleted-dda26afc-be95-4012-8949-0133f58eecdc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-changed-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Refreshing instance network info cache due to event network-changed-9ae1c222-8eca-4705-88d5-e43f1819c1ff. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a5a87a4-1b3a-43b0-8a13-42cda43d3154 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "9fb1125f-ce45-4cb6-83a0-d90e92f2569a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.057s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Instance network_info: |[{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Refreshing network info cache for port 9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Start _get_guest_xml network_info=[{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:58:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-466203827',display_name='tempest-ServerActionsTestOtherA-server-466203827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-466203827',id=16,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-qkqauffb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=b039f669-d399-49f3-baf5-4a21c8847ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6c:21,bridge_name='br-int',has_traffic_filtering=True,id=9ae1c222-8eca-4705-88d5-e43f1819c1ff,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ae1c222-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.objects.instance [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'pci_devices' on Instance uuid b039f669-d399-49f3-baf5-4a21c8847ab0 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:58:07 user nova-compute[75734]:   <uuid>b039f669-d399-49f3-baf5-4a21c8847ab0</uuid>
Nov 22 15:58:07 user nova-compute[75734]:   <name>instance-00000010</name>
Nov 22 15:58:07 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:58:07 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:58:07 user nova-compute[75734]:   <metadata>
Nov 22 15:58:07 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:58:07 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:58:07 user nova-compute[75734]:       <nova:name>tempest-ServerActionsTestOtherA-server-466203827</nova:name>
Nov 22 15:58:07 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:58:07</nova:creationTime>
Nov 22 15:58:07 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:58:07 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:58:07 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:58:07 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:58:07 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:58:07 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:58:07 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:58:07 user nova-compute[75734]:       <nova:owner>
Nov 22 15:58:07 user nova-compute[75734]:         <nova:user uuid="e9891b862488466e8e46427bbd19f742">tempest-ServerActionsTestOtherA-2146149591-project-member</nova:user>
Nov 22 15:58:07 user nova-compute[75734]:         <nova:project uuid="82865952d35349ffa829cf563d829fbe">tempest-ServerActionsTestOtherA-2146149591</nova:project>
Nov 22 15:58:07 user nova-compute[75734]:       </nova:owner>
Nov 22 15:58:07 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:58:07 user nova-compute[75734]:       <nova:ports>
Nov 22 15:58:07 user nova-compute[75734]:         <nova:port uuid="9ae1c222-8eca-4705-88d5-e43f1819c1ff">
Nov 22 15:58:07 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 15:58:07 user nova-compute[75734]:         </nova:port>
Nov 22 15:58:07 user nova-compute[75734]:       </nova:ports>
Nov 22 15:58:07 user nova-compute[75734]:     </nova:instance>
Nov 22 15:58:07 user nova-compute[75734]:   </metadata>
Nov 22 15:58:07 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:58:07 user nova-compute[75734]:     <system>
Nov 22 15:58:07 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:58:07 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:58:07 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:58:07 user nova-compute[75734]:       <entry name="serial">b039f669-d399-49f3-baf5-4a21c8847ab0</entry>
Nov 22 15:58:07 user nova-compute[75734]:       <entry name="uuid">b039f669-d399-49f3-baf5-4a21c8847ab0</entry>
Nov 22 15:58:07 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:58:07 user nova-compute[75734]:     </system>
Nov 22 15:58:07 user nova-compute[75734]:   </sysinfo>
Nov 22 15:58:07 user nova-compute[75734]:   <os>
Nov 22 15:58:07 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:58:07 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:58:07 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:58:07 user nova-compute[75734]:   </os>
Nov 22 15:58:07 user nova-compute[75734]:   <features>
Nov 22 15:58:07 user nova-compute[75734]:     <acpi/>
Nov 22 15:58:07 user nova-compute[75734]:     <apic/>
Nov 22 15:58:07 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:58:07 user nova-compute[75734]:   </features>
Nov 22 15:58:07 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:58:07 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:58:07 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:58:07 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:58:07 user nova-compute[75734]:   </clock>
Nov 22 15:58:07 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:58:07 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:58:07 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:58:07 user nova-compute[75734]:   </cpu>
Nov 22 15:58:07 user nova-compute[75734]:   <devices>
Nov 22 15:58:07 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:58:07 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:58:07 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk"/>
Nov 22 15:58:07 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:58:07 user nova-compute[75734]:     </disk>
Nov 22 15:58:07 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:58:07 user nova-compute[75734]:       <mac address="fa:16:3e:a7:6c:21"/>
Nov 22 15:58:07 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:58:07 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:58:07 user nova-compute[75734]:       <target dev="tap9ae1c222-8e"/>
Nov 22 15:58:07 user nova-compute[75734]:     </interface>
Nov 22 15:58:07 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:58:07 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/console.log" append="off"/>
Nov 22 15:58:07 user nova-compute[75734]:     </serial>
Nov 22 15:58:07 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:58:07 user nova-compute[75734]:     <video>
Nov 22 15:58:07 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:58:07 user nova-compute[75734]:     </video>
Nov 22 15:58:07 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:58:07 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:58:07 user nova-compute[75734]:     </rng>
Nov 22 15:58:07 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:58:07 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:58:07 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:58:07 user nova-compute[75734]:     </memballoon>
Nov 22 15:58:07 user nova-compute[75734]:   </devices>
Nov 22 15:58:07 user nova-compute[75734]: </domain>
Nov 22 15:58:07 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-466203827',display_name='tempest-ServerActionsTestOtherA-server-466203827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-466203827',id=16,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-qkqauffb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=b039f669-d399-49f3-baf5-4a21c8847ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6c:21,bridge_name='br-int',has_traffic_filtering=True,id=9ae1c222-8eca-4705-88d5-e43f1819c1ff,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ae1c222-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG os_vif [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6c:21,bridge_name='br-int',has_traffic_filtering=True,id=9ae1c222-8eca-4705-88d5-e43f1819c1ff,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ae1c222-8e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50a44ed2-5e42-5bf9-af33-6315dd668706', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ae1c222-8e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ae1c222-8e, col_values=(('qos', UUID('4485bde3-c97b-4662-b027-4f382807c3ed')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ae1c222-8e, col_values=(('external_ids', {'iface-id': '9ae1c222-8eca-4705-88d5-e43f1819c1ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:6c:21', 'vm-uuid': 'b039f669-d399-49f3-baf5-4a21c8847ab0'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:07 user nova-compute[75734]: INFO os_vif [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6c:21,bridge_name='br-int',has_traffic_filtering=True,id=9ae1c222-8eca-4705-88d5-e43f1819c1ff,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ae1c222-8e')
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:58:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No VIF found with MAC fa:16:3e:a7:6c:21, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:58:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updated VIF entry in instance network info cache for port 9ae1c222-8eca-4705-88d5-e43f1819c1ff. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:58:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-49186c14-d5a2-4df3-9d2e-64749ade7e68 req-e32ed728-8015-4473-b2c8-1a05d64b93cd service nova] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:58:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-d18173c4-8811-46b1-adc8-69ff8f366094 req-62a89620-a0d1-4390-881f-4366e1fe39de service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d18173c4-8811-46b1-adc8-69ff8f366094 req-62a89620-a0d1-4390-881f-4366e1fe39de service nova] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d18173c4-8811-46b1-adc8-69ff8f366094 req-62a89620-a0d1-4390-881f-4366e1fe39de service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d18173c4-8811-46b1-adc8-69ff8f366094 req-62a89620-a0d1-4390-881f-4366e1fe39de service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-d18173c4-8811-46b1-adc8-69ff8f366094 req-62a89620-a0d1-4390-881f-4366e1fe39de service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] No waiting events found dispatching network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:11 user nova-compute[75734]: WARNING nova.compute.manager [req-d18173c4-8811-46b1-adc8-69ff8f366094 req-62a89620-a0d1-4390-881f-4366e1fe39de service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received unexpected event network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff for instance with vm_state building and task_state spawning.
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:58:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Instance spawned successfully.
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:12 user nova-compute[75734]: INFO nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 22 15:58:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:58:12 user nova-compute[75734]: INFO nova.compute.manager [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Took 9.45 seconds to build instance.
Nov 22 15:58:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-13a863d2-4b58-4ec7-a53b-500da16ac941 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.573s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-dd799051-adb5-4773-bc2a-9207ffa3fde9 req-2c91b96b-30e1-417a-a6ff-a16dcf834ba2 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd799051-adb5-4773-bc2a-9207ffa3fde9 req-2c91b96b-30e1-417a-a6ff-a16dcf834ba2 service nova] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd799051-adb5-4773-bc2a-9207ffa3fde9 req-2c91b96b-30e1-417a-a6ff-a16dcf834ba2 service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd799051-adb5-4773-bc2a-9207ffa3fde9 req-2c91b96b-30e1-417a-a6ff-a16dcf834ba2 service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-dd799051-adb5-4773-bc2a-9207ffa3fde9 req-2c91b96b-30e1-417a-a6ff-a16dcf834ba2 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] No waiting events found dispatching network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:13 user nova-compute[75734]: WARNING nova.compute.manager [req-dd799051-adb5-4773-bc2a-9207ffa3fde9 req-2c91b96b-30e1-417a-a6ff-a16dcf834ba2 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received unexpected event network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff for instance with vm_state active and task_state None.
Nov 22 15:58:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:58:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:58:15 user nova-compute[75734]: INFO nova.compute.claims [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Claim successful on node user
Nov 22 15:58:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:58:16 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.policy [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5dd895a5e6e4c10a1a99a172d47b189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf712589524e98b21c4bbc6ff7e8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:58:16 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Creating image(s)
Nov 22 15:58:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.205s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.287s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk 1073741824" returned: 0 in 0.054s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Successfully created port: fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Cannot resize image /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Ensure instance console log exists: /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Successfully updated port: fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing instance network info cache due to event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance network_info: |[{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Start _get_guest_xml network_info=[{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:58:18 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:18 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1965206383',display_name='tempest-ServerStableDeviceRescueTest-server-1965206383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1965206383',id=17,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUk2XbUSRZkPVQX50ldN8fglFEZrOrx6bWFhvyl1nOEoIPJXUueaINERYMALQvtH7Yjd1nNJqLOm5HiLTN9Fahitj0OaOxYevgY2rTMJMdhFvy54R+Qnw3LFF1LeYoI7Q==',key_name='tempest-keypair-1287154213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7cf712589524e98b21c4bbc6ff7e8b6',ramdisk_id='',reservation_id='r-2lxxk9sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1050690507',owner_user_name='tempest-ServerStableDeviceRescueTest-1050690507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5dd895a5e6e4c10a1a99a172d47b189',uuid=820df13c-9f91-4a7a-a206-907e4f78817b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converting VIF {"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.objects.instance [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'pci_devices' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:58:18 user nova-compute[75734]:   <uuid>820df13c-9f91-4a7a-a206-907e4f78817b</uuid>
Nov 22 15:58:18 user nova-compute[75734]:   <name>instance-00000011</name>
Nov 22 15:58:18 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 15:58:18 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 15:58:18 user nova-compute[75734]:   <metadata>
Nov 22 15:58:18 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:58:18 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 15:58:18 user nova-compute[75734]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1965206383</nova:name>
Nov 22 15:58:18 user nova-compute[75734]:       <nova:creationTime>2023-11-22 15:58:18</nova:creationTime>
Nov 22 15:58:18 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 15:58:18 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 15:58:18 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 15:58:18 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 15:58:18 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:58:18 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:58:18 user nova-compute[75734]:       </nova:flavor>
Nov 22 15:58:18 user nova-compute[75734]:       <nova:owner>
Nov 22 15:58:18 user nova-compute[75734]:         <nova:user uuid="f5dd895a5e6e4c10a1a99a172d47b189">tempest-ServerStableDeviceRescueTest-1050690507-project-member</nova:user>
Nov 22 15:58:18 user nova-compute[75734]:         <nova:project uuid="a7cf712589524e98b21c4bbc6ff7e8b6">tempest-ServerStableDeviceRescueTest-1050690507</nova:project>
Nov 22 15:58:18 user nova-compute[75734]:       </nova:owner>
Nov 22 15:58:18 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 15:58:18 user nova-compute[75734]:       <nova:ports>
Nov 22 15:58:18 user nova-compute[75734]:         <nova:port uuid="fccdef99-6171-4f48-8296-4e814cf583bb">
Nov 22 15:58:18 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 15:58:18 user nova-compute[75734]:         </nova:port>
Nov 22 15:58:18 user nova-compute[75734]:       </nova:ports>
Nov 22 15:58:18 user nova-compute[75734]:     </nova:instance>
Nov 22 15:58:18 user nova-compute[75734]:   </metadata>
Nov 22 15:58:18 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 15:58:18 user nova-compute[75734]:     <system>
Nov 22 15:58:18 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:58:18 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:58:18 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 15:58:18 user nova-compute[75734]:       <entry name="serial">820df13c-9f91-4a7a-a206-907e4f78817b</entry>
Nov 22 15:58:18 user nova-compute[75734]:       <entry name="uuid">820df13c-9f91-4a7a-a206-907e4f78817b</entry>
Nov 22 15:58:18 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:58:18 user nova-compute[75734]:     </system>
Nov 22 15:58:18 user nova-compute[75734]:   </sysinfo>
Nov 22 15:58:18 user nova-compute[75734]:   <os>
Nov 22 15:58:18 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:58:18 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 15:58:18 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 15:58:18 user nova-compute[75734]:   </os>
Nov 22 15:58:18 user nova-compute[75734]:   <features>
Nov 22 15:58:18 user nova-compute[75734]:     <acpi/>
Nov 22 15:58:18 user nova-compute[75734]:     <apic/>
Nov 22 15:58:18 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 15:58:18 user nova-compute[75734]:   </features>
Nov 22 15:58:18 user nova-compute[75734]:   <clock offset="utc">
Nov 22 15:58:18 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:58:18 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:58:18 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 15:58:18 user nova-compute[75734]:   </clock>
Nov 22 15:58:18 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 15:58:18 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 15:58:18 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:58:18 user nova-compute[75734]:   </cpu>
Nov 22 15:58:18 user nova-compute[75734]:   <devices>
Nov 22 15:58:18 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 15:58:18 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:58:18 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk"/>
Nov 22 15:58:18 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 15:58:18 user nova-compute[75734]:     </disk>
Nov 22 15:58:18 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 15:58:18 user nova-compute[75734]:       <mac address="fa:16:3e:f7:34:18"/>
Nov 22 15:58:18 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:58:18 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 15:58:18 user nova-compute[75734]:       <target dev="tapfccdef99-61"/>
Nov 22 15:58:18 user nova-compute[75734]:     </interface>
Nov 22 15:58:18 user nova-compute[75734]:     <serial type="pty">
Nov 22 15:58:18 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/console.log" append="off"/>
Nov 22 15:58:18 user nova-compute[75734]:     </serial>
Nov 22 15:58:18 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:58:18 user nova-compute[75734]:     <video>
Nov 22 15:58:18 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 15:58:18 user nova-compute[75734]:     </video>
Nov 22 15:58:18 user nova-compute[75734]:     <rng model="virtio">
Nov 22 15:58:18 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:58:18 user nova-compute[75734]:     </rng>
Nov 22 15:58:18 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:58:18 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 15:58:18 user nova-compute[75734]:       <stats period="10"/>
Nov 22 15:58:18 user nova-compute[75734]:     </memballoon>
Nov 22 15:58:18 user nova-compute[75734]:   </devices>
Nov 22 15:58:18 user nova-compute[75734]: </domain>
Nov 22 15:58:18 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1965206383',display_name='tempest-ServerStableDeviceRescueTest-server-1965206383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1965206383',id=17,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUk2XbUSRZkPVQX50ldN8fglFEZrOrx6bWFhvyl1nOEoIPJXUueaINERYMALQvtH7Yjd1nNJqLOm5HiLTN9Fahitj0OaOxYevgY2rTMJMdhFvy54R+Qnw3LFF1LeYoI7Q==',key_name='tempest-keypair-1287154213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7cf712589524e98b21c4bbc6ff7e8b6',ramdisk_id='',reservation_id='r-2lxxk9sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1050690507',owner_user_name='tempest-ServerStableDeviceRescueTest-1050690507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5dd895a5e6e4c10a1a99a172d47b189',uuid=820df13c-9f91-4a7a-a206-907e4f78817b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converting VIF {"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG os_vif [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6e0814e-a519-51a9-a4a9-37f140b1b7e8', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfccdef99-61, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfccdef99-61, col_values=(('qos', UUID('8f9034d9-37c7-4d50-86cf-ce4a6bc9b8a9')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfccdef99-61, col_values=(('external_ids', {'iface-id': 'fccdef99-6171-4f48-8296-4e814cf583bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:34:18', 'vm-uuid': '820df13c-9f91-4a7a-a206-907e4f78817b'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:18 user nova-compute[75734]: INFO os_vif [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61')
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:58:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No VIF found with MAC fa:16:3e:f7:34:18, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:58:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updated VIF entry in instance network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:58:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef2b60de-909d-4ef4-a25f-1e5d71544bba req-f86130bc-9359-4740-a79a-6d7178432f0c service nova] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-245f941c-0d3f-440a-9dd2-22d58c93c635 req-f7ec1ed7-bd6d-4727-a893-64e72d1c7e85 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-245f941c-0d3f-440a-9dd2-22d58c93c635 req-f7ec1ed7-bd6d-4727-a893-64e72d1c7e85 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-245f941c-0d3f-440a-9dd2-22d58c93c635 req-f7ec1ed7-bd6d-4727-a893-64e72d1c7e85 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-245f941c-0d3f-440a-9dd2-22d58c93c635 req-f7ec1ed7-bd6d-4727-a893-64e72d1c7e85 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-245f941c-0d3f-440a-9dd2-22d58c93c635 req-f7ec1ed7-bd6d-4727-a893-64e72d1c7e85 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:20 user nova-compute[75734]: WARNING nova.compute.manager [req-245f941c-0d3f-440a-9dd2-22d58c93c635 req-f7ec1ed7-bd6d-4727-a893-64e72d1c7e85 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state building and task_state spawning.
Nov 22 15:58:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:58:22 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance spawned successfully.
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:58:22 user nova-compute[75734]: INFO nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-c0986883-6cd9-4254-9953-5b7879761e70 req-30301366-bb87-45e3-a51a-81ab25a9b852 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c0986883-6cd9-4254-9953-5b7879761e70 req-30301366-bb87-45e3-a51a-81ab25a9b852 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c0986883-6cd9-4254-9953-5b7879761e70 req-30301366-bb87-45e3-a51a-81ab25a9b852 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c0986883-6cd9-4254-9953-5b7879761e70 req-30301366-bb87-45e3-a51a-81ab25a9b852 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-c0986883-6cd9-4254-9953-5b7879761e70 req-30301366-bb87-45e3-a51a-81ab25a9b852 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:22 user nova-compute[75734]: WARNING nova.compute.manager [req-c0986883-6cd9-4254-9953-5b7879761e70 req-30301366-bb87-45e3-a51a-81ab25a9b852 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state building and task_state spawning.
Nov 22 15:58:22 user nova-compute[75734]: INFO nova.compute.manager [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Took 7.22 seconds to build instance.
Nov 22 15:58:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d808772-929d-40bb-8ce7-7888346d301f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.324s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 15:58:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 15:58:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 15:58:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:58:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:58:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:58:50 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:50 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7297MB free_disk=24.980857849121094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 820df13c-9f91-4a7a-a206-907e4f78817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 15:58:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:51 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:58:51 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:58:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:58:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.784s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:58:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:58 user nova-compute[75734]: INFO nova.compute.manager [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Terminating instance
Nov 22 15:58:58 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-8400a5e0-8828-4d35-85b2-8c251480783f req-0382761a-6bd3-4d3b-8db2-2ff672828c1b service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-vif-unplugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8400a5e0-8828-4d35-85b2-8c251480783f req-0382761a-6bd3-4d3b-8db2-2ff672828c1b service nova] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8400a5e0-8828-4d35-85b2-8c251480783f req-0382761a-6bd3-4d3b-8db2-2ff672828c1b service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8400a5e0-8828-4d35-85b2-8c251480783f req-0382761a-6bd3-4d3b-8db2-2ff672828c1b service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-8400a5e0-8828-4d35-85b2-8c251480783f req-0382761a-6bd3-4d3b-8db2-2ff672828c1b service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] No waiting events found dispatching network-vif-unplugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-8400a5e0-8828-4d35-85b2-8c251480783f req-0382761a-6bd3-4d3b-8db2-2ff672828c1b service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-vif-unplugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:58:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Instance destroyed successfully.
Nov 22 15:58:59 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lazy-loading 'resources' on Instance uuid 02833b01-4e0b-404a-8aae-d47fa0ac6794 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1854515589',display_name='tempest-VolumesAdminNegativeTest-server-1854515589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1854515589',id=4,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCOvlH6VrvD6XiuZu1fBmeIvstyHynMUxraLy+ukgRQHw+GAe4xplmGmp04ftCLZbta3Gd7x1KRzEC+qsIxfOXPwMLqm5eY34n3f8mCIFFzYO0IKLRl/zW29ZmsP53kPQ==',key_name='tempest-keypair-1439040736',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0495ec21f9b74a2e8d30e58d3ad504ff',ramdisk_id='',reservation_id='r-swcgzlil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1651481107',owner_user_name='tempest-VolumesAdminNegativeTest-1651481107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fc7f0844ed41488359c1dd43feeb66',uuid=02833b01-4e0b-404a-8aae-d47fa0ac6794,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converting VIF {"id": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "address": "fa:16:3e:2b:1c:be", "network": {"id": "4c0768c7-dd27-4406-9d2e-80f372ba8d38", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1349418117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0495ec21f9b74a2e8d30e58d3ad504ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa49cc3d-3e", "ovs_interfaceid": "aa49cc3d-3e41-4da9-ba4a-ed765f2eb485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa49cc3d-3e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG os_vif [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa49cc3d-3e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa49cc3d-3e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97847c61-1a06-49aa-a5e3-68b355934c77) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:58:59 user nova-compute[75734]: INFO os_vif [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485,network=Network(4c0768c7-dd27-4406-9d2e-80f372ba8d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa49cc3d-3e')
Nov 22 15:58:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Deleting instance files /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794_del
Nov 22 15:58:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Deletion of /opt/stack/data/nova/instances/02833b01-4e0b-404a-8aae-d47fa0ac6794_del complete
Nov 22 15:58:59 user nova-compute[75734]: INFO nova.compute.manager [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 22 15:58:59 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:58:59 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:00 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Took 0.71 seconds to deallocate network for instance.
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-0be25ebe-8545-4cfe-81e6-37fa9c5da69b req-f0053872-74b1-4c78-bbe9-e76147c9d88e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-vif-deleted-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:00 user nova-compute[75734]: INFO nova.compute.manager [req-0be25ebe-8545-4cfe-81e6-37fa9c5da69b req-f0053872-74b1-4c78-bbe9-e76147c9d88e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Neutron deleted interface aa49cc3d-3e41-4da9-ba4a-ed765f2eb485; detaching it from the instance and deleting it from the info cache
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.network.neutron [req-0be25ebe-8545-4cfe-81e6-37fa9c5da69b req-f0053872-74b1-4c78-bbe9-e76147c9d88e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-0be25ebe-8545-4cfe-81e6-37fa9c5da69b req-f0053872-74b1-4c78-bbe9-e76147c9d88e service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Detach interface failed, port_id=aa49cc3d-3e41-4da9-ba4a-ed765f2eb485, reason: Instance 02833b01-4e0b-404a-8aae-d47fa0ac6794 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:00 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Deleted allocations for instance 02833b01-4e0b-404a-8aae-d47fa0ac6794
Nov 22 15:59:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8f877754-91b1-4bec-8de1-c89189b2fb86 tempest-VolumesAdminNegativeTest-1651481107 tempest-VolumesAdminNegativeTest-1651481107-project-member] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-c7fe1ecf-577e-48d1-b229-f24134e0fd91 req-dc8acf35-1e4b-473f-b749-533c104f4eb5 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received event network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c7fe1ecf-577e-48d1-b229-f24134e0fd91 req-dc8acf35-1e4b-473f-b749-533c104f4eb5 service nova] Acquiring lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c7fe1ecf-577e-48d1-b229-f24134e0fd91 req-dc8acf35-1e4b-473f-b749-533c104f4eb5 service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c7fe1ecf-577e-48d1-b229-f24134e0fd91 req-dc8acf35-1e4b-473f-b749-533c104f4eb5 service nova] Lock "02833b01-4e0b-404a-8aae-d47fa0ac6794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-c7fe1ecf-577e-48d1-b229-f24134e0fd91 req-dc8acf35-1e4b-473f-b749-533c104f4eb5 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] No waiting events found dispatching network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:00 user nova-compute[75734]: WARNING nova.compute.manager [req-c7fe1ecf-577e-48d1-b229-f24134e0fd91 req-dc8acf35-1e4b-473f-b749-533c104f4eb5 service nova] [instance: 02833b01-4e0b-404a-8aae-d47fa0ac6794] Received unexpected event network-vif-plugged-aa49cc3d-3e41-4da9-ba4a-ed765f2eb485 for instance with vm_state deleted and task_state None.
Nov 22 15:59:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-changed-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Refreshing instance network info cache due to event network-changed-15e6a34b-4d97-4ae0-849e-8f64c4043ddd. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:59:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:59:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:59:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Refreshing network info cache for port 15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:59:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updated VIF entry in instance network info cache for port 15e6a34b-4d97-4ae0-849e-8f64c4043ddd. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:59:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-17c69940-2b16-486e-8a05-a54fd434841d req-86dd1468-c2a7-4ec9-a712-cafb34e310f5 service nova] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:59:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-changed-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Refreshing instance network info cache due to event network-changed-ab43788f-b69c-451f-ae7c-7bd41aca36a7. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:59:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] Acquiring lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:59:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] Acquired lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:59:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Refreshing network info cache for port ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updated VIF entry in instance network info cache for port ab43788f-b69c-451f-ae7c-7bd41aca36a7. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updating instance_info_cache with network_info: [{"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1e8144b4-427e-4d61-b105-4fcf88046e29 req-9e92161b-0aff-429d-8484-4b26f3d20850 service nova] Releasing lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'flavor' on Instance uuid d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:23 user nova-compute[75734]: INFO nova.compute.manager [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Attaching volume 5357196a-7d28-4aaf-b9bb-e55ec53f33a7 to /dev/vdb
Nov 22 15:59:23 user nova-compute[75734]: DEBUG os_brick.utils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac80d4e-13fa-4ff3-93a6-151943560525]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[af80989a-af91-47d6-a190-d814e29c2dd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0a707b-2d59-4c4b-8216-229cd220b6fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[93833d37-b9ab-4137-b02c-e746debb869b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:59:23 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:59:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c515933-4f6a-477e-9ebe-9ddd2d917322]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG os_brick.utils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:59:23 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updating existing volume attachment record: 6fba3503-732c-4f21-9b91-3795246e5b69 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:59:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:28 user nova-compute[75734]: INFO nova.compute.manager [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Unrescuing
Nov 22 15:59:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:59:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:59:28 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG nova.objects.instance [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'flavor' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-fb5f0947-ba72-4dd4-94ca-a23d5a71f244 req-b03faee3-34a3-48fa-a293-d7ecd2a9c6b5 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fb5f0947-ba72-4dd4-94ca-a23d5a71f244 req-b03faee3-34a3-48fa-a293-d7ecd2a9c6b5 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fb5f0947-ba72-4dd4-94ca-a23d5a71f244 req-b03faee3-34a3-48fa-a293-d7ecd2a9c6b5 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fb5f0947-ba72-4dd4-94ca-a23d5a71f244 req-b03faee3-34a3-48fa-a293-d7ecd2a9c6b5 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-fb5f0947-ba72-4dd4-94ca-a23d5a71f244 req-b03faee3-34a3-48fa-a293-d7ecd2a9c6b5 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:29 user nova-compute[75734]: WARNING nova.compute.manager [req-fb5f0947-ba72-4dd4-94ca-a23d5a71f244 req-b03faee3-34a3-48fa-a293-d7ecd2a9c6b5 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpuPxJlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:59:29 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:59:29 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:59:29 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[76472643-5e88-4fda-b8a0-8780e7e85e0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:59:29 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c93fd-4ec1-4bee-940e-04a1bdf9e82f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7] added
Nov 22 15:59:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e89b2d-1fa9-462b-be59-764fe8fb55bd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1ef692-8ebb-4855-a1ef-46c5a9f02078]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpuPxJlq {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpuPxJlq" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b3392-1114-45fa-919a-a4646768e5f7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tpuPxJlq'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb50d493-27e5-4648-aff4-a5a1ee04b887]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[722aeea9-4bb0-4aea-b004-acb34791c0d9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance destroyed successfully.
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7985f8-e681-4e72-a7c2-a4a8c5f48e4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260]
Nov 22 15:59:29 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260] successful.
Nov 22 15:59:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f7374c-8581-44a0-99e5-37f946f69091]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1fe08-5e61-4280-b332-ae5498257763]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:29 user nova-compute[75734]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 (non-flash)
Nov 22 15:59:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:29 user nova-compute[75734]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 (non-flash)
Nov 22 15:59:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38909c0-0203-4f3c-85ee-1197f99c5f67]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:59:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpuPxJlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:59:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:59:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23864623031363832', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:59:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864623031363832', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:59:30 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'flavor' on Instance uuid d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:59:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:59:30 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:59:30 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 15:59:30 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:59:30 user nova-compute[75734]:   <serial>5357196a-7d28-4aaf-b9bb-e55ec53f33a7</serial>
Nov 22 15:59:30 user nova-compute[75734]: </disk>
Nov 22 15:59:30 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] No VIF found with MAC fa:16:3e:88:39:b0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:31 user nova-compute[75734]: WARNING nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:31 user nova-compute[75734]: WARNING nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:31 user nova-compute[75734]: WARNING nova.compute.manager [req-cee9850a-942c-43aa-bb56-cbeda7093484 req-00c40f75-11fc-4152-b11e-29ab9df8e788 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ecd16352-b50c-4d69-a39e-80c68687d831 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.990s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6f0682e5-ca08-4102-b3d6-3cd149d3a2d6 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:59:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:33 user nova-compute[75734]: INFO nova.compute.manager [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Detaching volume 5357196a-7d28-4aaf-b9bb-e55ec53f33a7
Nov 22 15:59:33 user nova-compute[75734]: INFO nova.virt.block_device [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Attempting to driver detach volume 5357196a-7d28-4aaf-b9bb-e55ec53f33a7 from mountpoint /dev/vdb
Nov 22 15:59:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Attempting to detach device vdb from instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:59:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:59:33 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:59:33 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 15:59:33 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:59:33 user nova-compute[75734]:   <serial>5357196a-7d28-4aaf-b9bb-e55ec53f33a7</serial>
Nov 22 15:59:33 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:59:33 user nova-compute[75734]: </disk>
Nov 22 15:59:33 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:59:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully detached device vdb from instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 from the persistent domain config.
Nov 22 15:59:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:59:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:59:33 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:59:33 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 15:59:33 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:59:33 user nova-compute[75734]:   <serial>5357196a-7d28-4aaf-b9bb-e55ec53f33a7</serial>
Nov 22 15:59:33 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:59:33 user nova-compute[75734]: </disk>
Nov 22 15:59:33 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:59:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:59:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid fc118db4-cb7d-4887-80c8-853f3f76a33a {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 95cb311e-9de3-4cf9-8885-aab0c627a9cd {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid b039f669-d399-49f3-baf5-4a21c8847ab0 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:45 user nova-compute[75734]: INFO nova.compute.manager [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Unrescuing
Nov 22 15:59:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:59:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:59:45 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:59:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating instance_info_cache with network_info: [{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'flavor' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-changed-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Refreshing instance network info cache due to event network-changed-644b0c65-974c-4b94-a274-cda3a95eb66e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] Acquiring lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] Acquired lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.network.neutron [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Refreshing network info cache for port 644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-a804da33-03f1-4a02-8fb0-95313c7cdb13 req-82f6f738-23a9-48d6-aa9e-db45d8450afd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a804da33-03f1-4a02-8fb0-95313c7cdb13 req-82f6f738-23a9-48d6-aa9e-db45d8450afd service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a804da33-03f1-4a02-8fb0-95313c7cdb13 req-82f6f738-23a9-48d6-aa9e-db45d8450afd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a804da33-03f1-4a02-8fb0-95313c7cdb13 req-82f6f738-23a9-48d6-aa9e-db45d8450afd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-a804da33-03f1-4a02-8fb0-95313c7cdb13 req-82f6f738-23a9-48d6-aa9e-db45d8450afd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:46 user nova-compute[75734]: WARNING nova.compute.manager [req-a804da33-03f1-4a02-8fb0-95313c7cdb13 req-82f6f738-23a9-48d6-aa9e-db45d8450afd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.network.neutron [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Updated VIF entry in instance network info cache for port 644b0c65-974c-4b94-a274-cda3a95eb66e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG nova.network.neutron [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Updating instance_info_cache with network_info: [{"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e99090bf-db3b-4bbc-977d-13cb53f5d034 req-a6991dfe-0729-4b33-be0d-a6f3f1d2e427 service nova] Releasing lock "refresh_cache-95cb311e-9de3-4cf9-8885-aab0c627a9cd" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:47 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance destroyed successfully.
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:48 user nova-compute[75734]: WARNING nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:48 user nova-compute[75734]: WARNING nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:48 user nova-compute[75734]: WARNING nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:48 user nova-compute[75734]: WARNING nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:48 user nova-compute[75734]: WARNING nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:48 user nova-compute[75734]: WARNING nova.compute.manager [req-e796c8c1-4ac5-4d1a-a4c0-b483b12116b6 req-20258444-5dff-48fe-9da0-0a8b2eb036cd service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state rescued and task_state unrescuing.
Nov 22 15:59:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lazy-loading 'flavor' on Instance uuid 95cb311e-9de3-4cf9-8885-aab0c627a9cd {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:49 user nova-compute[75734]: INFO nova.compute.manager [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Attaching volume a4595376-7cda-4542-ade5-5834157dccbe to /dev/sdc
Nov 22 15:59:49 user nova-compute[75734]: DEBUG os_brick.utils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be270c9-901b-4940-a669-a2ff41eead5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c92f73-16b1-4d7b-846d-c07bbd5bc6ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20618a2-70ed-46b0-ba87-fde3ed4c3a43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959b78c-dfed-414f-881d-cfca0c7444ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:59:49 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc493a44-1a7e-431c-a428-aa718c3e829b]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG os_brick.utils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Updating existing volume attachment record: ec7592d8-e6b7-4f18-ac2d-a11d020558f7 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cc8b2e3f-b817-42ac-8d39-148c2bff5dbe tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-3849119b-7296-4bfd-a1da-27fab367f05a req-cbe53d7f-f6a7-48e7-a54c-894b34dcccb2 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3849119b-7296-4bfd-a1da-27fab367f05a req-cbe53d7f-f6a7-48e7-a54c-894b34dcccb2 service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3849119b-7296-4bfd-a1da-27fab367f05a req-cbe53d7f-f6a7-48e7-a54c-894b34dcccb2 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3849119b-7296-4bfd-a1da-27fab367f05a req-cbe53d7f-f6a7-48e7-a54c-894b34dcccb2 service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-3849119b-7296-4bfd-a1da-27fab367f05a req-cbe53d7f-f6a7-48e7-a54c-894b34dcccb2 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:59:50 user nova-compute[75734]: WARNING nova.compute.manager [req-3849119b-7296-4bfd-a1da-27fab367f05a req-cbe53d7f-f6a7-48e7-a54c-894b34dcccb2 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state None.
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:53 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:59:53 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7787MB free_disk=24.99654769897461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 820df13c-9f91-4a7a-a206-907e4f78817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-changed-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Refreshing instance network info cache due to event network-changed-9ae1c222-8eca-4705-88d5-e43f1819c1ff. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Refreshing network info cache for port 9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:59:53 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 is timed out.
Nov 22 15:59:53 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully detached device vdb from instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 from the live domain config.
Nov 22 15:59:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpuPxJlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:59:53 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:59:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:59:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f716f8-9209-483c-9ecc-e045757a1881]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:59:54 user nova-compute[75734]: No targets found.
Nov 22 15:59:54 user nova-compute[75734]: iSNS:
Nov 22 15:59:54 user nova-compute[75734]: No targets found.
Nov 22 15:59:54 user nova-compute[75734]: STATIC:
Nov 22 15:59:54 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 15:59:54 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:59:54 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:59:54 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7
Nov 22 15:59:54 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:59:54 user nova-compute[75734]:                 Iface Name: default
Nov 22 15:59:54 user nova-compute[75734]: FIRMWARE:
Nov 22 15:59:54 user nova-compute[75734]: No targets found.
Nov 22 15:59:54 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:59:54 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:59:54 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[66edc956-dfc3-488e-88f5-dfa26e144d7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd92883-580c-464b-ac97-a3f9ad33bf45]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:54 user nova-compute[75734]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 (non-flash)
Nov 22 15:59:54 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:54 user nova-compute[75734]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 (non-flash)
Nov 22 15:59:54 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7ced40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG nova.network.neutron [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updated VIF entry in instance network info cache for port 9ae1c222-8eca-4705-88d5-e43f1819c1ff. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG nova.network.neutron [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[088ac846-3b3e-49b4-8952-3961e82d0551]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eedf2035-b50f-450e-8f8f-01e2f9f66619 req-3340deb9-ff26-4170-b2b7-9ef4cd9c9a43 service nova] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a55ef-9dbe-4a3f-bf06-5a0f78059671]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f61039-b5bc-404e-94f9-eae8c717ed50]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e90c63f-3ef7-44f0-b775-6a8a79b508dc]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2ceaa4-6b36-4fee-8f4a-f3a30863a526]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0195b2a4-7f08-4445-883c-c437d1263bdf]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260]
Nov 22 15:59:54 user nova-compute[75734]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7, portal: 172.16.0.220,3260] successful.
Nov 22 15:59:54 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5357196a-7d28-4aaf-b9bb-e55ec53f33a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[43413170-16ee-4351-8362-1fce0eede560]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] <== disconnect_volume: return (321ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:59:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG nova.objects.instance [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'flavor' on Instance uuid d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updating instance_info_cache with network_info: [{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bd6d7924-85f3-4794-8cae-ef8483264435 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.188s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpJOCfnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:59:55 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:59:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:59:55 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:59:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:59:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:59:55 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:59:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d995f-c763-4fee-aebc-8eff8b18eddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:59:56 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ee1b27-b56f-488c-8d42-a85008233ef4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe] added
Nov 22 15:59:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5a3493-4b0a-4432-a17a-c24458daf4b0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d59884-c5dc-4a43-a7aa-8c5ff2f155e6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpJOCfnZ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpJOCfnZ" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf0b9e7-bf94-421a-8354-9442669c9d98]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpJOCfnZ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd34d057-3bca-44ec-9cb9-619abc9ccfa1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c823fcb-5eda-4c0d-bd41-b5afedb1a22d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b222e2-b93f-4dd5-8bbc-05320050a281]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260]
Nov 22 15:59:56 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260] successful.
Nov 22 15:59:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fe0c65-0417-4a6a-833c-97a5af688f43]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5b0114-6418-420e-ae2a-00d8e75b10c6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:56 user nova-compute[75734]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe (non-flash)
Nov 22 15:59:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 15:59:56 user nova-compute[75734]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe (non-flash)
Nov 22 15:59:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e04718a-9afe-4a0e-a826-e1cb176c6dfc]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:59:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpJOCfnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23532646239383865', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532646239383865', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lazy-loading 'flavor' on Instance uuid 95cb311e-9de3-4cf9-8885-aab0c627a9cd {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:59:57 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:59:57 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 15:59:57 user nova-compute[75734]:   <target dev="sdc" bus="scsi"/>
Nov 22 15:59:57 user nova-compute[75734]:   <serial>a4595376-7cda-4542-ade5-5834157dccbe</serial>
Nov 22 15:59:57 user nova-compute[75734]:   <address type="drive" controller="0" unit="2"/>
Nov 22 15:59:57 user nova-compute[75734]: </disk>
Nov 22 15:59:57 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] No BDM found with device name sda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] No VIF found with MAC fa:16:3e:95:1c:79, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:59:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1df339cd-1418-421d-a138-9099d5a67c13 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.445s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:59:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:59:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:59:58 user nova-compute[75734]: INFO nova.compute.manager [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Detaching volume a4595376-7cda-4542-ade5-5834157dccbe
Nov 22 15:59:58 user nova-compute[75734]: INFO nova.virt.block_device [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Attempting to driver detach volume a4595376-7cda-4542-ade5-5834157dccbe from mountpoint /dev/sdc
Nov 22 15:59:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Attempting to detach device sdc from instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:59:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:59:58 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:59:58 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 15:59:58 user nova-compute[75734]:   <target dev="sdc" bus="scsi"/>
Nov 22 15:59:58 user nova-compute[75734]:   <serial>a4595376-7cda-4542-ade5-5834157dccbe</serial>
Nov 22 15:59:58 user nova-compute[75734]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 22 15:59:58 user nova-compute[75734]: </disk>
Nov 22 15:59:58 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:59:58 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Successfully detached device sdc from instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd from the persistent domain config.
Nov 22 15:59:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:59:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:59:58 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:59:58 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 15:59:58 user nova-compute[75734]:   <target dev="sdc" bus="scsi"/>
Nov 22 15:59:58 user nova-compute[75734]:   <serial>a4595376-7cda-4542-ade5-5834157dccbe</serial>
Nov 22 15:59:58 user nova-compute[75734]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 22 15:59:58 user nova-compute[75734]: </disk>
Nov 22 15:59:58 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:59:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:59:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:00:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:05 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:00:05 user nova-compute[75734]: INFO nova.compute.claims [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Claim successful on node user
Nov 22 16:00:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:00:06 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.policy [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb5b3c03bbb490f9ef6f3f9c70bf9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7d5b5135ca46c2a649df3c1ce2ac64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:00:06 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Creating image(s)
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing instance network info cache due to event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk 1073741824" returned: 0 in 0.053s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Cannot resize image /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Ensure instance console log exists: /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updated VIF entry in instance network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9d0ccc6f-e90c-4c0b-9f0f-deeaa15cf4d0 req-1d1bcdde-6a87-48b0-91fb-49179dbdf52f service nova] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Successfully created port: 1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:00:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:00:07 user nova-compute[75734]: INFO nova.compute.manager [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] instance snapshotting
Nov 22 16:00:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Beginning live snapshot process
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Successfully updated port: 1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquired lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpin_8r8hp/65d5b4573a0644bcb7fa8147c11ed7f7.delta 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-changed-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Refreshing instance network info cache due to event network-changed-1c2cc3c5-35f5-42ce-9652-a202016bd053. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] Acquiring lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpin_8r8hp/65d5b4573a0644bcb7fa8147c11ed7f7.delta 1073741824" returned: 0 in 0.049s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Updating instance_info_cache with network_info: [{"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Releasing lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Instance network_info: |[{"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] Acquired lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Refreshing network info cache for port 1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Start _get_guest_xml network_info=[{"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:00:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:00:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:00:08 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888204927',display_name='tempest-AttachVolumeNegativeTest-server-1888204927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888204927',id=18,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN34Qi0266VZuWHwUq7fIUKrV8XrCFkv9a/ZluV/ME5zQCPPIW3LWG2JeAzuWTmlrHYVXskNOieqKXvLHkah8vEEa+6Sd+ldJIwP4wRpoDb/nVMn0sfjR+8QY8ewDUoGA==',key_name='tempest-keypair-1503422929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-e1ej7ogd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=a9bd2406-f5bb-4f1e-bae4-c0654554ac88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:48:86,bridge_name='br-int',has_traffic_filtering=True,id=1c2cc3c5-35f5-42ce-9652-a202016bd053,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2cc3c5-35') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'pci_devices' on Instance uuid a9bd2406-f5bb-4f1e-bae4-c0654554ac88 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:00:09 user nova-compute[75734]:   <uuid>a9bd2406-f5bb-4f1e-bae4-c0654554ac88</uuid>
Nov 22 16:00:09 user nova-compute[75734]:   <name>instance-00000012</name>
Nov 22 16:00:09 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:00:09 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:00:09 user nova-compute[75734]:   <metadata>
Nov 22 16:00:09 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:00:09 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:00:09 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1888204927</nova:name>
Nov 22 16:00:09 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:00:08</nova:creationTime>
Nov 22 16:00:09 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:00:09 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:00:09 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:00:09 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:00:09 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:00:09 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:00:09 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:00:09 user nova-compute[75734]:       <nova:owner>
Nov 22 16:00:09 user nova-compute[75734]:         <nova:user uuid="abb5b3c03bbb490f9ef6f3f9c70bf9d2">tempest-AttachVolumeNegativeTest-2104845353-project-member</nova:user>
Nov 22 16:00:09 user nova-compute[75734]:         <nova:project uuid="cb7d5b5135ca46c2a649df3c1ce2ac64">tempest-AttachVolumeNegativeTest-2104845353</nova:project>
Nov 22 16:00:09 user nova-compute[75734]:       </nova:owner>
Nov 22 16:00:09 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:00:09 user nova-compute[75734]:       <nova:ports>
Nov 22 16:00:09 user nova-compute[75734]:         <nova:port uuid="1c2cc3c5-35f5-42ce-9652-a202016bd053">
Nov 22 16:00:09 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 16:00:09 user nova-compute[75734]:         </nova:port>
Nov 22 16:00:09 user nova-compute[75734]:       </nova:ports>
Nov 22 16:00:09 user nova-compute[75734]:     </nova:instance>
Nov 22 16:00:09 user nova-compute[75734]:   </metadata>
Nov 22 16:00:09 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:00:09 user nova-compute[75734]:     <system>
Nov 22 16:00:09 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:00:09 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:00:09 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:00:09 user nova-compute[75734]:       <entry name="serial">a9bd2406-f5bb-4f1e-bae4-c0654554ac88</entry>
Nov 22 16:00:09 user nova-compute[75734]:       <entry name="uuid">a9bd2406-f5bb-4f1e-bae4-c0654554ac88</entry>
Nov 22 16:00:09 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:00:09 user nova-compute[75734]:     </system>
Nov 22 16:00:09 user nova-compute[75734]:   </sysinfo>
Nov 22 16:00:09 user nova-compute[75734]:   <os>
Nov 22 16:00:09 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:00:09 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:00:09 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:00:09 user nova-compute[75734]:   </os>
Nov 22 16:00:09 user nova-compute[75734]:   <features>
Nov 22 16:00:09 user nova-compute[75734]:     <acpi/>
Nov 22 16:00:09 user nova-compute[75734]:     <apic/>
Nov 22 16:00:09 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:00:09 user nova-compute[75734]:   </features>
Nov 22 16:00:09 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:00:09 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:00:09 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:00:09 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:00:09 user nova-compute[75734]:   </clock>
Nov 22 16:00:09 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:00:09 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:00:09 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:00:09 user nova-compute[75734]:   </cpu>
Nov 22 16:00:09 user nova-compute[75734]:   <devices>
Nov 22 16:00:09 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:00:09 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:00:09 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk"/>
Nov 22 16:00:09 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:00:09 user nova-compute[75734]:     </disk>
Nov 22 16:00:09 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:00:09 user nova-compute[75734]:       <mac address="fa:16:3e:da:48:86"/>
Nov 22 16:00:09 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:00:09 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:00:09 user nova-compute[75734]:       <target dev="tap1c2cc3c5-35"/>
Nov 22 16:00:09 user nova-compute[75734]:     </interface>
Nov 22 16:00:09 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:00:09 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/console.log" append="off"/>
Nov 22 16:00:09 user nova-compute[75734]:     </serial>
Nov 22 16:00:09 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:00:09 user nova-compute[75734]:     <video>
Nov 22 16:00:09 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:00:09 user nova-compute[75734]:     </video>
Nov 22 16:00:09 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:00:09 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:00:09 user nova-compute[75734]:     </rng>
Nov 22 16:00:09 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:00:09 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:00:09 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:00:09 user nova-compute[75734]:     </memballoon>
Nov 22 16:00:09 user nova-compute[75734]:   </devices>
Nov 22 16:00:09 user nova-compute[75734]: </domain>
Nov 22 16:00:09 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888204927',display_name='tempest-AttachVolumeNegativeTest-server-1888204927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888204927',id=18,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN34Qi0266VZuWHwUq7fIUKrV8XrCFkv9a/ZluV/ME5zQCPPIW3LWG2JeAzuWTmlrHYVXskNOieqKXvLHkah8vEEa+6Sd+ldJIwP4wRpoDb/nVMn0sfjR+8QY8ewDUoGA==',key_name='tempest-keypair-1503422929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-e1ej7ogd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=a9bd2406-f5bb-4f1e-bae4-c0654554ac88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:48:86,bridge_name='br-int',has_traffic_filtering=True,id=1c2cc3c5-35f5-42ce-9652-a202016bd053,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2cc3c5-35') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG os_vif [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:48:86,bridge_name='br-int',has_traffic_filtering=True,id=1c2cc3c5-35f5-42ce-9652-a202016bd053,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2cc3c5-35') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57854770-5b72-5e10-a808-f14f16ba5def', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c2cc3c5-35, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c2cc3c5-35, col_values=(('qos', UUID('6975589e-7956-48b4-8f66-1857ad3d7d43')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c2cc3c5-35, col_values=(('external_ids', {'iface-id': '1c2cc3c5-35f5-42ce-9652-a202016bd053', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:48:86', 'vm-uuid': 'a9bd2406-f5bb-4f1e-bae4-c0654554ac88'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:09 user nova-compute[75734]: INFO os_vif [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:48:86,bridge_name='br-int',has_traffic_filtering=True,id=1c2cc3c5-35f5-42ce-9652-a202016bd053,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2cc3c5-35')
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No VIF found with MAC fa:16:3e:da:48:86, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Updated VIF entry in instance network info cache for port 1c2cc3c5-35f5-42ce-9652-a202016bd053. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Updating instance_info_cache with network_info: [{"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8829321-9573-4d03-9931-04fb3836d641 req-07f0502c-2f57-4f9e-aba6-5d6af19af921 service nova] Releasing lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:00:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 16:00:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 16:00:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 16:00:10 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:00:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpin_8r8hp/65d5b4573a0644bcb7fa8147c11ed7f7.delta /opt/stack/data/nova/instances/snapshots/tmpin_8r8hp/65d5b4573a0644bcb7fa8147c11ed7f7 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-fda49d14-2ff9-4b1f-9154-b61ccd1f2c67 req-4739600d-87fa-4e4b-a187-2de884671f5f service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fda49d14-2ff9-4b1f-9154-b61ccd1f2c67 req-4739600d-87fa-4e4b-a187-2de884671f5f service nova] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fda49d14-2ff9-4b1f-9154-b61ccd1f2c67 req-4739600d-87fa-4e4b-a187-2de884671f5f service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fda49d14-2ff9-4b1f-9154-b61ccd1f2c67 req-4739600d-87fa-4e4b-a187-2de884671f5f service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-fda49d14-2ff9-4b1f-9154-b61ccd1f2c67 req-4739600d-87fa-4e4b-a187-2de884671f5f service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] No waiting events found dispatching network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:00:11 user nova-compute[75734]: WARNING nova.compute.manager [req-fda49d14-2ff9-4b1f-9154-b61ccd1f2c67 req-4739600d-87fa-4e4b-a187-2de884671f5f service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received unexpected event network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 for instance with vm_state building and task_state spawning.
Nov 22 16:00:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpin_8r8hp/65d5b4573a0644bcb7fa8147c11ed7f7.delta /opt/stack/data/nova/instances/snapshots/tmpin_8r8hp/65d5b4573a0644bcb7fa8147c11ed7f7" returned: 0 in 0.608s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:11 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Snapshot extracted, beginning image upload
Nov 22 16:00:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:00:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:00:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Instance spawned successfully.
Nov 22 16:00:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-cfc77596-3cae-4075-a2bd-8e440de99510 req-d43e08ff-e4c6-4273-b9cb-3eeae93cea54 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cfc77596-3cae-4075-a2bd-8e440de99510 req-d43e08ff-e4c6-4273-b9cb-3eeae93cea54 service nova] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cfc77596-3cae-4075-a2bd-8e440de99510 req-d43e08ff-e4c6-4273-b9cb-3eeae93cea54 service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cfc77596-3cae-4075-a2bd-8e440de99510 req-d43e08ff-e4c6-4273-b9cb-3eeae93cea54 service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-cfc77596-3cae-4075-a2bd-8e440de99510 req-d43e08ff-e4c6-4273-b9cb-3eeae93cea54 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] No waiting events found dispatching network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:00:13 user nova-compute[75734]: WARNING nova.compute.manager [req-cfc77596-3cae-4075-a2bd-8e440de99510 req-d43e08ff-e4c6-4273-b9cb-3eeae93cea54 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received unexpected event network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 for instance with vm_state building and task_state spawning.
Nov 22 16:00:13 user nova-compute[75734]: INFO nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 22 16:00:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:00:13 user nova-compute[75734]: INFO nova.compute.manager [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Took 7.42 seconds to build instance.
Nov 22 16:00:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c92b6455-12cf-4594-a4fb-9fa3cbdd9764 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.518s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Snapshot image upload complete
Nov 22 16:00:13 user nova-compute[75734]: INFO nova.compute.manager [None req-fd03e7a9-a04e-4a4f-81df-2f7340d33e67 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Took 5.76 seconds to snapshot the instance on the hypervisor.
Nov 22 16:00:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:18 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd is timed out.
Nov 22 16:00:18 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Successfully detached device sdc from instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd from the live domain config.
Nov 22 16:00:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpJOCfnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:00:18 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9204a048-c87b-481c-955a-c8e205e65d13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:00:18 user nova-compute[75734]: No targets found.
Nov 22 16:00:18 user nova-compute[75734]: iSNS:
Nov 22 16:00:18 user nova-compute[75734]: No targets found.
Nov 22 16:00:18 user nova-compute[75734]: STATIC:
Nov 22 16:00:18 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:00:18 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:00:18 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:00:18 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe
Nov 22 16:00:18 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:00:18 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:00:18 user nova-compute[75734]: FIRMWARE:
Nov 22 16:00:18 user nova-compute[75734]: No targets found.
Nov 22 16:00:18 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:00:18 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:00:18 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[557ee787-9ec3-487c-aa98-56ed87ccc7db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda7287f-956c-4283-8fdc-d9cb1f9bd354]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:00:18 user nova-compute[75734]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe (non-flash)
Nov 22 16:00:18 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:00:18 user nova-compute[75734]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe (non-flash)
Nov 22 16:00:18 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7f2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[26545991-7944-46f4-9d8a-d73cf2df6ff9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1273365a-87ad-41a9-8eaf-6e116e653d5f]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a745ff-0e08-40f9-b56e-0114eb0a95fd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4f508-6ab1-4418-856b-3ece6bf7966b]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf8d5f-ded3-4224-aaee-c116faea6070]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd69c049-1e14-4da6-8e29-b8cafd37ac1a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260]
Nov 22 16:00:19 user nova-compute[75734]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe, portal: 172.16.0.220,3260] successful.
Nov 22 16:00:19 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4595376-7cda-4542-ade5-5834157dccbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764b189-b864-49d8-93e1-0e628dc89d69]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] <== disconnect_volume: return (280ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG nova.objects.instance [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lazy-loading 'flavor' on Instance uuid 95cb311e-9de3-4cf9-8885-aab0c627a9cd {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:00:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-95158c29-cfb2-4d8c-815e-cfc2c6d1d058 tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.574s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:21 user nova-compute[75734]: INFO nova.compute.manager [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Terminating instance
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d0959e1-4bb5-45de-8196-cbbcb09f979f req-31fb2365-660c-4f71-959f-c6a76605e60d service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-vif-unplugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d0959e1-4bb5-45de-8196-cbbcb09f979f req-31fb2365-660c-4f71-959f-c6a76605e60d service nova] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d0959e1-4bb5-45de-8196-cbbcb09f979f req-31fb2365-660c-4f71-959f-c6a76605e60d service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d0959e1-4bb5-45de-8196-cbbcb09f979f req-31fb2365-660c-4f71-959f-c6a76605e60d service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d0959e1-4bb5-45de-8196-cbbcb09f979f req-31fb2365-660c-4f71-959f-c6a76605e60d service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] No waiting events found dispatching network-vif-unplugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d0959e1-4bb5-45de-8196-cbbcb09f979f req-31fb2365-660c-4f71-959f-c6a76605e60d service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-vif-unplugged-644b0c65-974c-4b94-a274-cda3a95eb66e for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:00:21 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Instance destroyed successfully.
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.objects.instance [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lazy-loading 'resources' on Instance uuid 95cb311e-9de3-4cf9-8885-aab0c627a9cd {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T15:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-209506314',display_name='tempest-AttachSCSIVolumeTestJSON-server-209506314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-209506314',id=15,image_ref='db2b9fc8-0506-47dd-8bcb-3511aba7f702',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl5+VmV+vK/W5Ik1UrPEl72Rd/+S1TTzD1Ow7RYJHeWWEgSkTuMd1CibCqhQYSo9jDUtzDPgUzaHv/4Tuj/1N1j3p2fgewS2SRjqEMcGGSFDUgk2bm8mlrE1cJAUR6qYw==',key_name='tempest-keypair-767241237',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f76c06e71a947e7a25edf5c46ee6779',ramdisk_id='',reservation_id='r-a302xk90',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db2b9fc8-0506-47dd-8bcb-3511aba7f702',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-695499499',owner_user_name='tempest-AttachSCSIVolumeTestJSON-695499499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa239ed83f2a4634b9a5ed3629b6e1ec',uuid=95cb311e-9de3-4cf9-8885-aab0c627a9cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Converting VIF {"id": "644b0c65-974c-4b94-a274-cda3a95eb66e", "address": "fa:16:3e:95:1c:79", "network": {"id": "e69939c6-b35d-403f-b131-7d9e21b968ee", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-248167990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f76c06e71a947e7a25edf5c46ee6779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644b0c65-97", "ovs_interfaceid": "644b0c65-974c-4b94-a274-cda3a95eb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:1c:79,bridge_name='br-int',has_traffic_filtering=True,id=644b0c65-974c-4b94-a274-cda3a95eb66e,network=Network(e69939c6-b35d-403f-b131-7d9e21b968ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644b0c65-97') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG os_vif [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:1c:79,bridge_name='br-int',has_traffic_filtering=True,id=644b0c65-974c-4b94-a274-cda3a95eb66e,network=Network(e69939c6-b35d-403f-b131-7d9e21b968ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644b0c65-97') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap644b0c65-97, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0777b778-56c8-4b29-b3ca-dd9d494eb932) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:21 user nova-compute[75734]: INFO os_vif [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:1c:79,bridge_name='br-int',has_traffic_filtering=True,id=644b0c65-974c-4b94-a274-cda3a95eb66e,network=Network(e69939c6-b35d-403f-b131-7d9e21b968ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644b0c65-97')
Nov 22 16:00:21 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Deleting instance files /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd_del
Nov 22 16:00:21 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Deletion of /opt/stack/data/nova/instances/95cb311e-9de3-4cf9-8885-aab0c627a9cd_del complete
Nov 22 16:00:22 user nova-compute[75734]: INFO nova.compute.manager [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 16:00:22 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:00:22 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:00:22 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:00:22 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:00:22 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Took 0.81 seconds to deallocate network for instance.
Nov 22 16:00:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:23 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Deleted allocations for instance 95cb311e-9de3-4cf9-8885-aab0c627a9cd
Nov 22 16:00:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e52c686-8213-4b3c-826b-11cca8120a9b tempest-AttachSCSIVolumeTestJSON-695499499 tempest-AttachSCSIVolumeTestJSON-695499499-project-member] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-9cccb45f-86a4-4763-b345-3094dfda650d req-2a773412-8d06-418b-838b-4fe286694393 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9cccb45f-86a4-4763-b345-3094dfda650d req-2a773412-8d06-418b-838b-4fe286694393 service nova] Acquiring lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9cccb45f-86a4-4763-b345-3094dfda650d req-2a773412-8d06-418b-838b-4fe286694393 service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9cccb45f-86a4-4763-b345-3094dfda650d req-2a773412-8d06-418b-838b-4fe286694393 service nova] Lock "95cb311e-9de3-4cf9-8885-aab0c627a9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-9cccb45f-86a4-4763-b345-3094dfda650d req-2a773412-8d06-418b-838b-4fe286694393 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] No waiting events found dispatching network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:00:23 user nova-compute[75734]: WARNING nova.compute.manager [req-9cccb45f-86a4-4763-b345-3094dfda650d req-2a773412-8d06-418b-838b-4fe286694393 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received unexpected event network-vif-plugged-644b0c65-974c-4b94-a274-cda3a95eb66e for instance with vm_state deleted and task_state None.
Nov 22 16:00:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-9cccb45f-86a4-4763-b345-3094dfda650d req-2a773412-8d06-418b-838b-4fe286694393 service nova] [instance: 95cb311e-9de3-4cf9-8885-aab0c627a9cd] Received event network-vif-deleted-644b0c65-974c-4b94-a274-cda3a95eb66e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-changed-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Refreshing instance network info cache due to event network-changed-ab43788f-b69c-451f-ae7c-7bd41aca36a7. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] Acquiring lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] Acquired lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Refreshing network info cache for port ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:24 user nova-compute[75734]: INFO nova.compute.manager [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Terminating instance
Nov 22 16:00:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updated VIF entry in instance network info cache for port ab43788f-b69c-451f-ae7c-7bd41aca36a7. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updating instance_info_cache with network_info: [{"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b308b2c7-2eff-4161-871e-3d8501819c52 req-e756db67-b89b-4d22-8695-e97e5466b43c service nova] Releasing lock "refresh_cache-d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:00:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Instance destroyed successfully.
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'resources' on Instance uuid d17ec0bc-ab9f-4127-b22c-2023ff1c0e30 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-169801306',display_name='tempest-TestStampPattern-server-169801306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-169801306',id=14,image_ref='57efd17e-73d7-4e04-926d-c44542a2f48c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr2F0xWX4V7cn83ISOfWR0ZWxAnt6203RwWMULSxvl2kcpmW50rLf6b1v+ZQY/JOZAnLEv+bGDYOSPNFyXR/xFl+3u2Yo1jVj5aBO/pRMHr8SQlBV/9R2tVPWk55zdVYA==',key_name='tempest-TestStampPattern-1711431298',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8378dfb8a70149df8f2cb392ee80e44f',ramdisk_id='',reservation_id='r-mhnf0dwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3',image_min_disk='1',image_min_ram='0',image_owner_id='8378dfb8a70149df8f2cb392ee80e44f',image_owner_project_name='tempest-TestStampPattern-2140441883',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2140441883-project-member',image_user_id='9c080eee08c34b80ae54aa0ed9893c4c',owner_project_name='tempest-TestStampPattern-2140441883',owner_user_name='tempest-TestStampPattern-2140441883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:57:38Z,user_data=None,user_id='9c080eee08c34b80ae54aa0ed9893c4c',uuid=d17ec0bc-ab9f-4127-b22c-2023ff1c0e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converting VIF {"id": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "address": "fa:16:3e:88:39:b0", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab43788f-b6", "ovs_interfaceid": "ab43788f-b69c-451f-ae7c-7bd41aca36a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:39:b0,bridge_name='br-int',has_traffic_filtering=True,id=ab43788f-b69c-451f-ae7c-7bd41aca36a7,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab43788f-b6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG os_vif [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:39:b0,bridge_name='br-int',has_traffic_filtering=True,id=ab43788f-b69c-451f-ae7c-7bd41aca36a7,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab43788f-b6') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab43788f-b6, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b5b1a40-8c8c-4122-b1c1-f3d3fb7cd9dc) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:25 user nova-compute[75734]: INFO os_vif [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:39:b0,bridge_name='br-int',has_traffic_filtering=True,id=ab43788f-b69c-451f-ae7c-7bd41aca36a7,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab43788f-b6')
Nov 22 16:00:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Deleting instance files /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30_del
Nov 22 16:00:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Deletion of /opt/stack/data/nova/instances/d17ec0bc-ab9f-4127-b22c-2023ff1c0e30_del complete
Nov 22 16:00:25 user nova-compute[75734]: INFO nova.compute.manager [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 22 16:00:25 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:00:25 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Took 0.44 seconds to deallocate network for instance.
Nov 22 16:00:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-9b7b2ce1-078f-4026-93f5-4888cbbb4edb req-d37a75c0-7660-4474-b08f-a065ba89bda2 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-vif-deleted-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-vif-unplugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] No waiting events found dispatching network-vif-unplugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:00:26 user nova-compute[75734]: WARNING nova.compute.manager [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received unexpected event network-vif-unplugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 for instance with vm_state deleted and task_state None.
Nov 22 16:00:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received event network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] Acquiring lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] No waiting events found dispatching network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:00:26 user nova-compute[75734]: WARNING nova.compute.manager [req-12383ded-6126-4f6c-9744-82f290211d4d req-9de66725-7b50-419a-a81f-cfd9e1ed6499 service nova] [instance: d17ec0bc-ab9f-4127-b22c-2023ff1c0e30] Received unexpected event network-vif-plugged-ab43788f-b69c-451f-ae7c-7bd41aca36a7 for instance with vm_state deleted and task_state None.
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.815s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:26 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Deleted allocations for instance d17ec0bc-ab9f-4127-b22c-2023ff1c0e30
Nov 22 16:00:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2f1986d-5a39-4082-8c73-a431059a64e6 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "d17ec0bc-ab9f-4127-b22c-2023ff1c0e30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.387s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:00:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:00:52 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:00:52 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=24.938373565673828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 820df13c-9f91-4a7a-a206-907e4f78817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:00:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:00:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:00:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:00:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:59 user nova-compute[75734]: DEBUG nova.objects.instance [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lazy-loading 'flavor' on Instance uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:00:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:00:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:00:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:00:59 user nova-compute[75734]: INFO nova.compute.manager [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Attaching volume 0a8acc4b-79f1-4119-a687-3c95bdd79e6d to /dev/vdb
Nov 22 16:01:00 user nova-compute[75734]: DEBUG os_brick.utils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fe4051-c3fc-4228-a0dd-900e83159aa0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6611ffe-e258-46d3-96ff-0b67c05e6cf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1e8b3c-ff50-4afc-b726-96806b040225]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf217914-c3a5-4b7f-9b5a-91f469b8d288]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:01:00 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:01:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a04a6b-40b7-47d6-9a28-05d289f89dfa]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG os_brick.utils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating existing volume attachment record: 7a318b5a-2aa5-4706-a8e1-4df3fd495190 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:01:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:01:05 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:01:05 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:01:05 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d0c770-e1ed-4a96-b040-d088eb5366d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:01:05 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca4f4a1-8593-4f0a-a115-d151db3505c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d] added
Nov 22 16:01:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a52c7-513c-4bc9-acea-2e380a5ec0e1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f920c211-a0fb-4cb1-8734-5f6146fa6c30]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxfresZS {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxfresZS" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be9449e-3aee-4950-98fa-88ecb2e61a3c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxfresZS'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e63571-5511-43ff-88f7-e3ec71d071c8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a8781d-2016-4275-b16e-86d9820bf369]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:01:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93dd71-0e81-4d91-91a8-cfa799ffd78d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]
Nov 22 16:01:06 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.
Nov 22 16:01:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9bb958-232b-463f-9dcc-6cd1076e6a92]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6f62a-bc18-4bda-8242-4e3dc656fb56]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:06 user nova-compute[75734]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:01:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:06 user nova-compute[75734]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:01:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f253d-a6bb-48b2-bf5e-9b1d5fe21459]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:06 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23431633464656639', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431633464656639', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG nova.objects.instance [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lazy-loading 'flavor' on Instance uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:01:07 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:01:07 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:01:07 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:01:07 user nova-compute[75734]:   <serial>0a8acc4b-79f1-4119-a687-3c95bdd79e6d</serial>
Nov 22 16:01:07 user nova-compute[75734]: </disk>
Nov 22 16:01:07 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No VIF found with MAC fa:16:3e:26:22:8a, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:01:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-08b125bf-e371-4ac5-a9bb-13889f03fd87 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.792s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG nova.compute.manager [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Stashing vm_state: active {{(pid=75734) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:01:10 user nova-compute[75734]: INFO nova.compute.claims [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Claim successful on node user
Nov 22 16:01:10 user nova-compute[75734]: INFO nova.compute.resource_tracker [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating resource usage from migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb
Nov 22 16:01:10 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.402s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:10 user nova-compute[75734]: INFO nova.compute.manager [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Migrating
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:10 user nova-compute[75734]: INFO nova.compute.rpcapi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:10 user nova-compute[75734]: DEBUG nova.network.neutron [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG nova.network.neutron [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Starting migrate_disk_and_power_off {{(pid=75734) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-50677815-77fa-46e9-b783-8e6fe4d3e237 req-65e16b40-833c-457b-9633-9d52041dde0f service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-50677815-77fa-46e9-b783-8e6fe4d3e237 req-65e16b40-833c-457b-9633-9d52041dde0f service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-50677815-77fa-46e9-b783-8e6fe4d3e237 req-65e16b40-833c-457b-9633-9d52041dde0f service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-50677815-77fa-46e9-b783-8e6fe4d3e237 req-65e16b40-833c-457b-9633-9d52041dde0f service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-50677815-77fa-46e9-b783-8e6fe4d3e237 req-65e16b40-833c-457b-9633-9d52041dde0f service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:11 user nova-compute[75734]: WARNING nova.compute.manager [req-50677815-77fa-46e9-b783-8e6fe4d3e237 req-65e16b40-833c-457b-9633-9d52041dde0f service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state active and task_state resize_migrating.
Nov 22 16:01:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance destroyed successfully.
Nov 22 16:01:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025175957-network", "vif_mac": "fa:16:3e:26:22:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025175957-network", "vif_mac": "fa:16:3e:26:22:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_vif [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e6a34b-4d, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4313752-7464-406f-91e9-2fbb98a7f26a) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:12 user nova-compute[75734]: INFO os_vif [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d')
Nov 22 16:01:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:01:12 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b255cea-2279-4e86-8c88-0cc4f6287768]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:01:12 user nova-compute[75734]: No targets found.
Nov 22 16:01:12 user nova-compute[75734]: iSNS:
Nov 22 16:01:12 user nova-compute[75734]: No targets found.
Nov 22 16:01:12 user nova-compute[75734]: STATIC:
Nov 22 16:01:12 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:01:12 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:01:12 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:01:12 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:01:12 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:01:12 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:01:12 user nova-compute[75734]: FIRMWARE:
Nov 22 16:01:12 user nova-compute[75734]: No targets found.
Nov 22 16:01:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:01:12 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:01:12 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64232e-c159-4a24-9615-311eae5cf91b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56c9f8-62ba-4867-9543-3880170f5764]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:12 user nova-compute[75734]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:01:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:12 user nova-compute[75734]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:01:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac60dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[97237fa7-c10a-4271-8cc4-5fd0c909b404]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9490db8-ece4-4310-ad6d-def047b7d8c2]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8970a-4a1d-4e5e-9a0f-76596b5f844d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2516f575-47a2-4b3d-87ab-b3c81789dae3]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9df7e71-dbdb-4e85-8491-b4b7dc94e347]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[43519ec6-d40a-406b-b4af-93d567981600]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]
Nov 22 16:01:12 user nova-compute[75734]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.
Nov 22 16:01:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[56625f6d-7b3d-429b-bca3-0e8da95a9a86]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== disconnect_volume: return (344ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:01:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc_resize/disk /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "cp -r /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc_resize/disk /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk" returned: 0 in 0.338s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc_resize/disk.info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk.info {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "cp -r /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc_resize/disk.info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk.info" returned: 0 in 0.034s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-59f40767-b73f-46a6-8a92-d27cee30fd53 req-23778340-22d4-4e5b-9558-3a75e7958e6d service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-59f40767-b73f-46a6-8a92-d27cee30fd53 req-23778340-22d4-4e5b-9558-3a75e7958e6d service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-59f40767-b73f-46a6-8a92-d27cee30fd53 req-23778340-22d4-4e5b-9558-3a75e7958e6d service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-59f40767-b73f-46a6-8a92-d27cee30fd53 req-23778340-22d4-4e5b-9558-3a75e7958e6d service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-59f40767-b73f-46a6-8a92-d27cee30fd53 req-23778340-22d4-4e5b-9558-3a75e7958e6d service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:13 user nova-compute[75734]: WARNING nova.compute.manager [req-59f40767-b73f-46a6-8a92-d27cee30fd53 req-23778340-22d4-4e5b-9558-3a75e7958e6d service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state active and task_state resize_migrating.
Nov 22 16:01:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Port 15e6a34b-4d97-4ae0-849e-8f64c4043ddd binding to destination host user is already ACTIVE {{(pid=75734) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 16:01:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c1cb7f-efca-4b38-94f0-3d7297f2a83d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed14dc-a3d9-40c5-a06a-49ce92e540ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5774e0f-09bd-46d4-ab6d-4ffc0c5eeb2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1538f8-1b23-4908-822b-5f9f176594fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:01:16 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:01:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4063d7ad-2f62-41a0-a6b7-9415b9a63616]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:01:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:01:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-changed-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Refreshing instance network info cache due to event network-changed-4de00436-a2b1-4725-bb63-35109e31d750. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] Acquiring lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] Acquired lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Refreshing network info cache for port 4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:22 user nova-compute[75734]: INFO nova.compute.manager [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Terminating instance
Nov 22 16:01:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updated VIF entry in instance network info cache for port 4de00436-a2b1-4725-bb63-35109e31d750. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updating instance_info_cache with network_info: [{"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3d647696-1753-4899-b845-df5a99c71e98 req-dca34724-cc71-4800-afb3-1d7b3a70639f service nova] Releasing lock "refresh_cache-9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Instance destroyed successfully.
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lazy-loading 'resources' on Instance uuid 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-204290539',display_name='tempest-TestStampPattern-server-204290539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-204290539',id=10,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr2F0xWX4V7cn83ISOfWR0ZWxAnt6203RwWMULSxvl2kcpmW50rLf6b1v+ZQY/JOZAnLEv+bGDYOSPNFyXR/xFl+3u2Yo1jVj5aBO/pRMHr8SQlBV/9R2tVPWk55zdVYA==',key_name='tempest-TestStampPattern-1711431298',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8378dfb8a70149df8f2cb392ee80e44f',ramdisk_id='',reservation_id='r-uxdb6g5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2140441883',owner_user_name='tempest-TestStampPattern-2140441883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:57:28Z,user_data=None,user_id='9c080eee08c34b80ae54aa0ed9893c4c',uuid=9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converting VIF {"id": "4de00436-a2b1-4725-bb63-35109e31d750", "address": "fa:16:3e:3f:a7:77", "network": {"id": "5f2c1d2a-930b-487e-a5ce-05bd5a49c124", "bridge": "br-int", "label": "tempest-TestStampPattern-1265818996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8378dfb8a70149df8f2cb392ee80e44f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de00436-a2", "ovs_interfaceid": "4de00436-a2b1-4725-bb63-35109e31d750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:a7:77,bridge_name='br-int',has_traffic_filtering=True,id=4de00436-a2b1-4725-bb63-35109e31d750,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de00436-a2') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG os_vif [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:a7:77,bridge_name='br-int',has_traffic_filtering=True,id=4de00436-a2b1-4725-bb63-35109e31d750,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de00436-a2') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4de00436-a2, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c1a5153-3d6e-41db-baa2-8e8a812d0707) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:23 user nova-compute[75734]: INFO os_vif [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:a7:77,bridge_name='br-int',has_traffic_filtering=True,id=4de00436-a2b1-4725-bb63-35109e31d750,network=Network(5f2c1d2a-930b-487e-a5ce-05bd5a49c124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de00436-a2')
Nov 22 16:01:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Deleting instance files /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3_del
Nov 22 16:01:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Deletion of /opt/stack/data/nova/instances/9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3_del complete
Nov 22 16:01:23 user nova-compute[75734]: INFO nova.compute.manager [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 22 16:01:23 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:23 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Took 0.39 seconds to deallocate network for instance.
Nov 22 16:01:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-d082038e-378c-468c-9bfa-4927fde9e1a5 req-19dfda81-bdcb-4eb2-9978-4862d4675bb4 service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-vif-deleted-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Starting finish_migration {{(pid=75734) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 16:01:24 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Creating image(s)
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:24 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Deleted allocations for instance 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.200s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk. size=21474836480 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-vif-unplugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] No waiting events found dispatching network-vif-unplugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:24 user nova-compute[75734]: WARNING nova.compute.manager [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received unexpected event network-vif-unplugged-4de00436-a2b1-4725-bb63-35109e31d750 for instance with vm_state deleted and task_state None.
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received event network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] Acquiring lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] No waiting events found dispatching network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:24 user nova-compute[75734]: WARNING nova.compute.manager [req-aefede0a-d89a-4cf9-b536-e31e2366df06 req-f3d22f9a-2a34-42be-b7f2-7ba07d054eeb service nova] [instance: 9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3] Received unexpected event network-vif-plugged-4de00436-a2b1-4725-bb63-35109e31d750 for instance with vm_state deleted and task_state None.
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a617138c-8737-44b1-9c82-73f8cf4e77c3 tempest-TestStampPattern-2140441883 tempest-TestStampPattern-2140441883-project-member] Lock "9e9c1d5d-b8ae-4d6e-bd59-0fc8b76437f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.955s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk 21474836480 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk 21474836480" returned: 0 in 0.048s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Ensure instance console log exists: /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Start _get_guest_xml network_info=[{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025175957-network", "vif_mac": "fa:16:3e:26:22:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2dd8d531-0a85-40f2-a710-b76a74ca6e96', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5dbde2ab-53f7-46db-a454-bcc8980833dc', 'attached_at': '2023-11-22T16:01:24.000000', 'detached_at': '', 'volume_id': '0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'serial': '0a8acc4b-79f1-4119-a687-3c95bdd79e6d'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:01:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:01:24 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:01:24 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:01:24 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9104e214-b498-4820-80e1-bbb15b0febfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:01:24 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06fcec-73aa-473e-8f19-beac98850cb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d] added
Nov 22 16:01:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[55791ce9-a3be-408d-9912-176ef42edcc7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73a8c6-6508-4f3e-96d8-0fddfe93bffd]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxfresZS {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxfresZS" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19612ef-4953-49aa-ae68-ec2c14946210]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxfresZS'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:01:24 user nova-compute[75734]: INFO nova.compute.claims [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Claim successful on node user
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c7b2e1-9864-47e6-80e5-56e081297f55]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b535a55-e0f8-4113-bfa6-c71fb14d74ed]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:01:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e94b7-dcfb-439a-a80c-6a1e5c44c623]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]
Nov 22 16:01:25 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.
Nov 22 16:01:25 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9b6427-f25c-463f-a309-4092e64cf11c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ff8887-794b-4bfa-8f3d-b3fa46ba3ff0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:25 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:01:25 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:01:25 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:01:25 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0811fda-4a52-47ab-adc5-94f91d92c878]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:01:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.policy [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea603e7c80014f17a76fec19b54443c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963ad36880484ed59f2b34c64a6e450e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:01:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Creating image(s)
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk 1073741824" returned: 0 in 0.061s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Successfully created port: 05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23431633464656639', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431633464656639', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025175957-network", "vif_mac": "fa:16:3e:26:22:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025175957-network", "vif_mac": "fa:16:3e:26:22:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:01:26 user nova-compute[75734]:   <uuid>5dbde2ab-53f7-46db-a454-bcc8980833dc</uuid>
Nov 22 16:01:26 user nova-compute[75734]:   <name>instance-0000000d</name>
Nov 22 16:01:26 user nova-compute[75734]:   <memory>2097152</memory>
Nov 22 16:01:26 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:01:26 user nova-compute[75734]:   <metadata>
Nov 22 16:01:26 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:01:26 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:01:26 user nova-compute[75734]:       <nova:name>tempest-ServerActionsTestOtherB-server-707148199</nova:name>
Nov 22 16:01:26 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:01:24</nova:creationTime>
Nov 22 16:01:26 user nova-compute[75734]:       <nova:flavor name="m1.small">
Nov 22 16:01:26 user nova-compute[75734]:         <nova:memory>2048</nova:memory>
Nov 22 16:01:26 user nova-compute[75734]:         <nova:disk>20</nova:disk>
Nov 22 16:01:26 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:01:26 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:01:26 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:01:26 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:01:26 user nova-compute[75734]:       <nova:owner>
Nov 22 16:01:26 user nova-compute[75734]:         <nova:user uuid="4b585828df0c4d2786a02ff5621a0732">tempest-ServerActionsTestOtherB-1674044799-project-member</nova:user>
Nov 22 16:01:26 user nova-compute[75734]:         <nova:project uuid="5d179eb8ada444378bb4412630b6e12a">tempest-ServerActionsTestOtherB-1674044799</nova:project>
Nov 22 16:01:26 user nova-compute[75734]:       </nova:owner>
Nov 22 16:01:26 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:01:26 user nova-compute[75734]:       <nova:ports>
Nov 22 16:01:26 user nova-compute[75734]:         <nova:port uuid="15e6a34b-4d97-4ae0-849e-8f64c4043ddd">
Nov 22 16:01:26 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 16:01:26 user nova-compute[75734]:         </nova:port>
Nov 22 16:01:26 user nova-compute[75734]:       </nova:ports>
Nov 22 16:01:26 user nova-compute[75734]:     </nova:instance>
Nov 22 16:01:26 user nova-compute[75734]:   </metadata>
Nov 22 16:01:26 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:01:26 user nova-compute[75734]:     <system>
Nov 22 16:01:26 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:01:26 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:01:26 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:01:26 user nova-compute[75734]:       <entry name="serial">5dbde2ab-53f7-46db-a454-bcc8980833dc</entry>
Nov 22 16:01:26 user nova-compute[75734]:       <entry name="uuid">5dbde2ab-53f7-46db-a454-bcc8980833dc</entry>
Nov 22 16:01:26 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:01:26 user nova-compute[75734]:     </system>
Nov 22 16:01:26 user nova-compute[75734]:   </sysinfo>
Nov 22 16:01:26 user nova-compute[75734]:   <os>
Nov 22 16:01:26 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:01:26 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:01:26 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:01:26 user nova-compute[75734]:   </os>
Nov 22 16:01:26 user nova-compute[75734]:   <features>
Nov 22 16:01:26 user nova-compute[75734]:     <acpi/>
Nov 22 16:01:26 user nova-compute[75734]:     <apic/>
Nov 22 16:01:26 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:01:26 user nova-compute[75734]:   </features>
Nov 22 16:01:26 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:01:26 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:01:26 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:01:26 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:01:26 user nova-compute[75734]:   </clock>
Nov 22 16:01:26 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:01:26 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:01:26 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:01:26 user nova-compute[75734]:   </cpu>
Nov 22 16:01:26 user nova-compute[75734]:   <devices>
Nov 22 16:01:26 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:01:26 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:01:26 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk"/>
Nov 22 16:01:26 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:01:26 user nova-compute[75734]:     </disk>
Nov 22 16:01:26 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:01:26 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:01:26 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:01:26 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:01:26 user nova-compute[75734]:       <serial>0a8acc4b-79f1-4119-a687-3c95bdd79e6d</serial>
Nov 22 16:01:26 user nova-compute[75734]:     </disk>
Nov 22 16:01:26 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:01:26 user nova-compute[75734]:       <mac address="fa:16:3e:26:22:8a"/>
Nov 22 16:01:26 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:26 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:01:26 user nova-compute[75734]:       <target dev="tap15e6a34b-4d"/>
Nov 22 16:01:26 user nova-compute[75734]:     </interface>
Nov 22 16:01:26 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:01:26 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/console.log" append="off"/>
Nov 22 16:01:26 user nova-compute[75734]:     </serial>
Nov 22 16:01:26 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:01:26 user nova-compute[75734]:     <video>
Nov 22 16:01:26 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:26 user nova-compute[75734]:     </video>
Nov 22 16:01:26 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:01:26 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:01:26 user nova-compute[75734]:     </rng>
Nov 22 16:01:26 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:01:26 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:01:26 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:01:26 user nova-compute[75734]:     </memballoon>
Nov 22 16:01:26 user nova-compute[75734]:   </devices>
Nov 22 16:01:26 user nova-compute[75734]: </domain>
Nov 22 16:01:26 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025175957-network", "vif_mac": "fa:16:3e:26:22:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025175957-network", "vif_mac": "fa:16:3e:26:22:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG os_vif [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbc2679d-5524-5c99-91e9-8e5ce0b5058a', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e6a34b-4d, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15e6a34b-4d, col_values=(('qos', UUID('c2773bda-9085-44e9-8474-b78194c409f4')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15e6a34b-4d, col_values=(('external_ids', {'iface-id': '15e6a34b-4d97-4ae0-849e-8f64c4043ddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:22:8a', 'vm-uuid': '5dbde2ab-53f7-46db-a454-bcc8980833dc'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:26 user nova-compute[75734]: INFO os_vif [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d')
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] No VIF found with MAC fa:16:3e:26:22:8a, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Cannot resize image /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Ensure instance console log exists: /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Successfully updated port: 05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing instance network info cache due to event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] Acquiring lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance network_info: |[{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] Acquired lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Start _get_guest_xml network_info=[{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:01:27 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:27 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1052250505',display_name='tempest-ServerRescueNegativeTestJSON-server-1052250505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1052250505',id=19,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV+1ijUPIxlObi7Otae2ssSP0pilyTlOPtuJzQIeQzKupfZ+pUbwSRpE2UOpK5LFKQ8PTYGl1ziklby0PniLrCSyXVOTJ2L3HudeI/U9Ag02k4cBlmGTYLHNrflOILtfQ==',key_name='tempest-keypair-124342039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-vwg1bjqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea603e7c80014f17a76fec19b54443c9',uuid=15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.objects.instance [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'pci_devices' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:01:27 user nova-compute[75734]:   <uuid>15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c</uuid>
Nov 22 16:01:27 user nova-compute[75734]:   <name>instance-00000013</name>
Nov 22 16:01:27 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:01:27 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:01:27 user nova-compute[75734]:   <metadata>
Nov 22 16:01:27 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:01:27 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:01:27 user nova-compute[75734]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1052250505</nova:name>
Nov 22 16:01:27 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:01:27</nova:creationTime>
Nov 22 16:01:27 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:01:27 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:01:27 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:01:27 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:01:27 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:01:27 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:01:27 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:01:27 user nova-compute[75734]:       <nova:owner>
Nov 22 16:01:27 user nova-compute[75734]:         <nova:user uuid="ea603e7c80014f17a76fec19b54443c9">tempest-ServerRescueNegativeTestJSON-970419785-project-member</nova:user>
Nov 22 16:01:27 user nova-compute[75734]:         <nova:project uuid="963ad36880484ed59f2b34c64a6e450e">tempest-ServerRescueNegativeTestJSON-970419785</nova:project>
Nov 22 16:01:27 user nova-compute[75734]:       </nova:owner>
Nov 22 16:01:27 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:01:27 user nova-compute[75734]:       <nova:ports>
Nov 22 16:01:27 user nova-compute[75734]:         <nova:port uuid="05b840f9-4c08-477c-99c5-72dcd541d8e6">
Nov 22 16:01:27 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 16:01:27 user nova-compute[75734]:         </nova:port>
Nov 22 16:01:27 user nova-compute[75734]:       </nova:ports>
Nov 22 16:01:27 user nova-compute[75734]:     </nova:instance>
Nov 22 16:01:27 user nova-compute[75734]:   </metadata>
Nov 22 16:01:27 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:01:27 user nova-compute[75734]:     <system>
Nov 22 16:01:27 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:01:27 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:01:27 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:01:27 user nova-compute[75734]:       <entry name="serial">15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c</entry>
Nov 22 16:01:27 user nova-compute[75734]:       <entry name="uuid">15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c</entry>
Nov 22 16:01:27 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:01:27 user nova-compute[75734]:     </system>
Nov 22 16:01:27 user nova-compute[75734]:   </sysinfo>
Nov 22 16:01:27 user nova-compute[75734]:   <os>
Nov 22 16:01:27 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:01:27 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:01:27 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:01:27 user nova-compute[75734]:   </os>
Nov 22 16:01:27 user nova-compute[75734]:   <features>
Nov 22 16:01:27 user nova-compute[75734]:     <acpi/>
Nov 22 16:01:27 user nova-compute[75734]:     <apic/>
Nov 22 16:01:27 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:01:27 user nova-compute[75734]:   </features>
Nov 22 16:01:27 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:01:27 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:01:27 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:01:27 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:01:27 user nova-compute[75734]:   </clock>
Nov 22 16:01:27 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:01:27 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:01:27 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:01:27 user nova-compute[75734]:   </cpu>
Nov 22 16:01:27 user nova-compute[75734]:   <devices>
Nov 22 16:01:27 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:01:27 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:01:27 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk"/>
Nov 22 16:01:27 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:01:27 user nova-compute[75734]:     </disk>
Nov 22 16:01:27 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:01:27 user nova-compute[75734]:       <mac address="fa:16:3e:97:23:9f"/>
Nov 22 16:01:27 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:27 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:01:27 user nova-compute[75734]:       <target dev="tap05b840f9-4c"/>
Nov 22 16:01:27 user nova-compute[75734]:     </interface>
Nov 22 16:01:27 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:01:27 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/console.log" append="off"/>
Nov 22 16:01:27 user nova-compute[75734]:     </serial>
Nov 22 16:01:27 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:01:27 user nova-compute[75734]:     <video>
Nov 22 16:01:27 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:27 user nova-compute[75734]:     </video>
Nov 22 16:01:27 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:01:27 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:01:27 user nova-compute[75734]:     </rng>
Nov 22 16:01:27 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:01:27 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:01:27 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:01:27 user nova-compute[75734]:     </memballoon>
Nov 22 16:01:27 user nova-compute[75734]:   </devices>
Nov 22 16:01:27 user nova-compute[75734]: </domain>
Nov 22 16:01:27 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1052250505',display_name='tempest-ServerRescueNegativeTestJSON-server-1052250505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1052250505',id=19,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV+1ijUPIxlObi7Otae2ssSP0pilyTlOPtuJzQIeQzKupfZ+pUbwSRpE2UOpK5LFKQ8PTYGl1ziklby0PniLrCSyXVOTJ2L3HudeI/U9Ag02k4cBlmGTYLHNrflOILtfQ==',key_name='tempest-keypair-124342039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-vwg1bjqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea603e7c80014f17a76fec19b54443c9',uuid=15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG os_vif [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a522a8d-ce58-52e1-8c7f-24505aaaf9b0', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05b840f9-4c, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05b840f9-4c, col_values=(('qos', UUID('e0cd40ec-6646-466f-8cc7-2a07ed172c54')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05b840f9-4c, col_values=(('external_ids', {'iface-id': '05b840f9-4c08-477c-99c5-72dcd541d8e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:23:9f', 'vm-uuid': '15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: INFO os_vif [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c')
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No VIF found with MAC fa:16:3e:97:23:9f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updated VIF entry in instance network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-923a142c-7ed0-4c50-8650-1f0b89dd4cc2 req-f7f45239-8771-4f33-968e-6f7f725feef0 service nova] Releasing lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:28 user nova-compute[75734]: WARNING nova.compute.manager [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state active and task_state resize_finish.
Nov 22 16:01:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:28 user nova-compute[75734]: WARNING nova.compute.manager [req-9f9ebd09-fe00-40cf-90dc-a76a36f75ed1 req-9e933beb-ec95-4d5d-9107-bc05026ada53 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state active and task_state resize_finish.
Nov 22 16:01:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:30 user nova-compute[75734]: WARNING nova.compute.manager [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state building and task_state spawning.
Nov 22 16:01:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:30 user nova-compute[75734]: WARNING nova.compute.manager [req-53c67f99-a055-4390-a683-9e3f1156c4cf req-a05bca61-ced0-4c28-9448-76393682bf8d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state building and task_state spawning.
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:01:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance running successfully.
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Failed to set time: agent not configured {{(pid=75734) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-79760cc2-543f-477b-8e93-28bfbc9a9808 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] finish_migration finished successfully. {{(pid=75734) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.048s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:01:31 user nova-compute[75734]: INFO nova.compute.claims [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Claim successful on node user
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:01:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance spawned successfully.
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:31 user nova-compute[75734]: INFO nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:01:31 user nova-compute[75734]: INFO nova.compute.manager [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Took 6.85 seconds to build instance.
Nov 22 16:01:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dd5aacb3-6a5b-4fa8-86a4-bff576eb7653 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.961s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.network.neutron [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:01:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:01:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.policy [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '034e5954946d4b65a60c328edbfffeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6771bb37f7bf493e9790d4f35ddba288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:01:32 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Creating image(s)
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "/opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "/opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "/opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk 1073741824" returned: 0 in 0.055s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.network.neutron [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Successfully created port: 7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.199s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Cannot resize image /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Ensure instance console log exists: /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Successfully updated port: 7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "refresh_cache-423a0127-0a4d-4a90-af6b-777bbd7080d9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquired lock "refresh_cache-423a0127-0a4d-4a90-af6b-777bbd7080d9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received event network-changed-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Refreshing instance network info cache due to event network-changed-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] Acquiring lock "refresh_cache-423a0127-0a4d-4a90-af6b-777bbd7080d9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Updating instance_info_cache with network_info: [{"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Releasing lock "refresh_cache-423a0127-0a4d-4a90-af6b-777bbd7080d9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Instance network_info: |[{"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] Acquired lock "refresh_cache-423a0127-0a4d-4a90-af6b-777bbd7080d9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.neutron [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Refreshing network info cache for port 7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Start _get_guest_xml network_info=[{"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:01:33 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:33 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-625653779',display_name='tempest-DeleteServersTestJSON-server-625653779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-625653779',id=20,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6771bb37f7bf493e9790d4f35ddba288',ramdisk_id='',reservation_id='r-3ttep5jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-819563755',owner_user_name='tempest-DeleteServersTestJSON-819563755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:32Z,user_data=None,user_id='034e5954946d4b65a60c328edbfffeb5',uuid=423a0127-0a4d-4a90-af6b-777bbd7080d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Converting VIF {"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=7c7f01d0-1f91-4007-9f7c-c3c80d158f1e,network=Network(6eff52f9-33b9-4590-a2ba-c555ba578a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7f01d0-1f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lazy-loading 'pci_devices' on Instance uuid 423a0127-0a4d-4a90-af6b-777bbd7080d9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:01:33 user nova-compute[75734]:   <uuid>423a0127-0a4d-4a90-af6b-777bbd7080d9</uuid>
Nov 22 16:01:33 user nova-compute[75734]:   <name>instance-00000014</name>
Nov 22 16:01:33 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:01:33 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:01:33 user nova-compute[75734]:   <metadata>
Nov 22 16:01:33 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:01:33 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:01:33 user nova-compute[75734]:       <nova:name>tempest-DeleteServersTestJSON-server-625653779</nova:name>
Nov 22 16:01:33 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:01:33</nova:creationTime>
Nov 22 16:01:33 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:01:33 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:01:33 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:01:33 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:01:33 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:01:33 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:01:33 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:01:33 user nova-compute[75734]:       <nova:owner>
Nov 22 16:01:33 user nova-compute[75734]:         <nova:user uuid="034e5954946d4b65a60c328edbfffeb5">tempest-DeleteServersTestJSON-819563755-project-member</nova:user>
Nov 22 16:01:33 user nova-compute[75734]:         <nova:project uuid="6771bb37f7bf493e9790d4f35ddba288">tempest-DeleteServersTestJSON-819563755</nova:project>
Nov 22 16:01:33 user nova-compute[75734]:       </nova:owner>
Nov 22 16:01:33 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:01:33 user nova-compute[75734]:       <nova:ports>
Nov 22 16:01:33 user nova-compute[75734]:         <nova:port uuid="7c7f01d0-1f91-4007-9f7c-c3c80d158f1e">
Nov 22 16:01:33 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 16:01:33 user nova-compute[75734]:         </nova:port>
Nov 22 16:01:33 user nova-compute[75734]:       </nova:ports>
Nov 22 16:01:33 user nova-compute[75734]:     </nova:instance>
Nov 22 16:01:33 user nova-compute[75734]:   </metadata>
Nov 22 16:01:33 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:01:33 user nova-compute[75734]:     <system>
Nov 22 16:01:33 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:01:33 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:01:33 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:01:33 user nova-compute[75734]:       <entry name="serial">423a0127-0a4d-4a90-af6b-777bbd7080d9</entry>
Nov 22 16:01:33 user nova-compute[75734]:       <entry name="uuid">423a0127-0a4d-4a90-af6b-777bbd7080d9</entry>
Nov 22 16:01:33 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:01:33 user nova-compute[75734]:     </system>
Nov 22 16:01:33 user nova-compute[75734]:   </sysinfo>
Nov 22 16:01:33 user nova-compute[75734]:   <os>
Nov 22 16:01:33 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:01:33 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:01:33 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:01:33 user nova-compute[75734]:   </os>
Nov 22 16:01:33 user nova-compute[75734]:   <features>
Nov 22 16:01:33 user nova-compute[75734]:     <acpi/>
Nov 22 16:01:33 user nova-compute[75734]:     <apic/>
Nov 22 16:01:33 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:01:33 user nova-compute[75734]:   </features>
Nov 22 16:01:33 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:01:33 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:01:33 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:01:33 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:01:33 user nova-compute[75734]:   </clock>
Nov 22 16:01:33 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:01:33 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:01:33 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:01:33 user nova-compute[75734]:   </cpu>
Nov 22 16:01:33 user nova-compute[75734]:   <devices>
Nov 22 16:01:33 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:01:33 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:01:33 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk"/>
Nov 22 16:01:33 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:01:33 user nova-compute[75734]:     </disk>
Nov 22 16:01:33 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:01:33 user nova-compute[75734]:       <mac address="fa:16:3e:a1:a0:d0"/>
Nov 22 16:01:33 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:33 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:01:33 user nova-compute[75734]:       <target dev="tap7c7f01d0-1f"/>
Nov 22 16:01:33 user nova-compute[75734]:     </interface>
Nov 22 16:01:33 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:01:33 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/console.log" append="off"/>
Nov 22 16:01:33 user nova-compute[75734]:     </serial>
Nov 22 16:01:33 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:01:33 user nova-compute[75734]:     <video>
Nov 22 16:01:33 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:33 user nova-compute[75734]:     </video>
Nov 22 16:01:33 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:01:33 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:01:33 user nova-compute[75734]:     </rng>
Nov 22 16:01:33 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:01:33 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:01:33 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:01:33 user nova-compute[75734]:     </memballoon>
Nov 22 16:01:33 user nova-compute[75734]:   </devices>
Nov 22 16:01:33 user nova-compute[75734]: </domain>
Nov 22 16:01:33 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-625653779',display_name='tempest-DeleteServersTestJSON-server-625653779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-625653779',id=20,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6771bb37f7bf493e9790d4f35ddba288',ramdisk_id='',reservation_id='r-3ttep5jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-819563755',owner_user_name='tempest-DeleteServersTestJSON-819563755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:32Z,user_data=None,user_id='034e5954946d4b65a60c328edbfffeb5',uuid=423a0127-0a4d-4a90-af6b-777bbd7080d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Converting VIF {"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=7c7f01d0-1f91-4007-9f7c-c3c80d158f1e,network=Network(6eff52f9-33b9-4590-a2ba-c555ba578a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7f01d0-1f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG os_vif [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=7c7f01d0-1f91-4007-9f7c-c3c80d158f1e,network=Network(6eff52f9-33b9-4590-a2ba-c555ba578a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7f01d0-1f') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5463ac10-57db-5917-8d03-36d1c45a0f2f', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c7f01d0-1f, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c7f01d0-1f, col_values=(('qos', UUID('416d48ec-3fa7-4167-909a-e62ffd40e56c')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c7f01d0-1f, col_values=(('external_ids', {'iface-id': '7c7f01d0-1f91-4007-9f7c-c3c80d158f1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:a0:d0', 'vm-uuid': '423a0127-0a4d-4a90-af6b-777bbd7080d9'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:33 user nova-compute[75734]: INFO os_vif [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=7c7f01d0-1f91-4007-9f7c-c3c80d158f1e,network=Network(6eff52f9-33b9-4590-a2ba-c555ba578a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7f01d0-1f')
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] No VIF found with MAC fa:16:3e:a1:a0:d0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:01:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Updated VIF entry in instance network info cache for port 7c7f01d0-1f91-4007-9f7c-c3c80d158f1e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:01:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Updating instance_info_cache with network_info: [{"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b226e56c-c1d8-481c-81f0-c720a0d28364 req-e99506ef-c628-4ea3-9056-f8cdf271a99b service nova] Releasing lock "refresh_cache-423a0127-0a4d-4a90-af6b-777bbd7080d9" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-9dff7d8e-e59e-4d31-9bd1-87781dfc0486 req-967481f6-a545-4705-970f-8bc4dd707bf7 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received event network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9dff7d8e-e59e-4d31-9bd1-87781dfc0486 req-967481f6-a545-4705-970f-8bc4dd707bf7 service nova] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9dff7d8e-e59e-4d31-9bd1-87781dfc0486 req-967481f6-a545-4705-970f-8bc4dd707bf7 service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9dff7d8e-e59e-4d31-9bd1-87781dfc0486 req-967481f6-a545-4705-970f-8bc4dd707bf7 service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-9dff7d8e-e59e-4d31-9bd1-87781dfc0486 req-967481f6-a545-4705-970f-8bc4dd707bf7 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] No waiting events found dispatching network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:35 user nova-compute[75734]: WARNING nova.compute.manager [req-9dff7d8e-e59e-4d31-9bd1-87781dfc0486 req-967481f6-a545-4705-970f-8bc4dd707bf7 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received unexpected event network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e for instance with vm_state building and task_state spawning.
Nov 22 16:01:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:01:37 user nova-compute[75734]: INFO nova.compute.claims [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Claim successful on node user
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-18cfabf2-0b8e-41af-95f8-924a136931a8 req-fca2a9a2-10d1-4368-86b4-276c75e64e62 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received event network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-18cfabf2-0b8e-41af-95f8-924a136931a8 req-fca2a9a2-10d1-4368-86b4-276c75e64e62 service nova] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-18cfabf2-0b8e-41af-95f8-924a136931a8 req-fca2a9a2-10d1-4368-86b4-276c75e64e62 service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-18cfabf2-0b8e-41af-95f8-924a136931a8 req-fca2a9a2-10d1-4368-86b4-276c75e64e62 service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-18cfabf2-0b8e-41af-95f8-924a136931a8 req-fca2a9a2-10d1-4368-86b4-276c75e64e62 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] No waiting events found dispatching network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:37 user nova-compute[75734]: WARNING nova.compute.manager [req-18cfabf2-0b8e-41af-95f8-924a136931a8 req-fca2a9a2-10d1-4368-86b4-276c75e64e62 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received unexpected event network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e for instance with vm_state building and task_state spawning.
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:01:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:01:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Instance spawned successfully.
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.policy [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dc99ff4c7054545a10673afb2cf930b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234cf12714b74b12aa027c8fff2e784e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:01:37 user nova-compute[75734]: INFO nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:01:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Creating image(s)
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "/opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:38 user nova-compute[75734]: INFO nova.compute.manager [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Took 6.71 seconds to build instance.
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-88c80e74-6a71-4829-96bb-8c719018c2b9 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.829s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.206s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Successfully created port: aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.219s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk 1073741824" returned: 0 in 0.069s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.204s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Cannot resize image /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Ensure instance console log exists: /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Successfully updated port: aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-c76e93b4-c666-4a61-a09f-8ec45fee55d4" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-c76e93b4-c666-4a61-a09f-8ec45fee55d4" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received event network-changed-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Refreshing instance network info cache due to event network-changed-aade74b3-cd01-47c0-8443-2a1ae23343af. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] Acquiring lock "refresh_cache-c76e93b4-c666-4a61-a09f-8ec45fee55d4" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.neutron [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Updating instance_info_cache with network_info: [{"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-c76e93b4-c666-4a61-a09f-8ec45fee55d4" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Instance network_info: |[{"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] Acquired lock "refresh_cache-c76e93b4-c666-4a61-a09f-8ec45fee55d4" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Refreshing network info cache for port aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Start _get_guest_xml network_info=[{"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:01:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1861221698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1861221698',id=21,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-q441otei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:38Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=c76e93b4-c666-4a61-a09f-8ec45fee55d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b1:44,bridge_name='br-int',has_traffic_filtering=True,id=aade74b3-cd01-47c0-8443-2a1ae23343af,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaade74b3-cd') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'pci_devices' on Instance uuid c76e93b4-c666-4a61-a09f-8ec45fee55d4 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:01:39 user nova-compute[75734]:   <uuid>c76e93b4-c666-4a61-a09f-8ec45fee55d4</uuid>
Nov 22 16:01:39 user nova-compute[75734]:   <name>instance-00000015</name>
Nov 22 16:01:39 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:01:39 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:01:39 user nova-compute[75734]:   <metadata>
Nov 22 16:01:39 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:01:39 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:01:39 user nova-compute[75734]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1861221698</nova:name>
Nov 22 16:01:39 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:01:39</nova:creationTime>
Nov 22 16:01:39 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:01:39 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:01:39 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:01:39 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:01:39 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:01:39 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:01:39 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:01:39 user nova-compute[75734]:       <nova:owner>
Nov 22 16:01:39 user nova-compute[75734]:         <nova:user uuid="5dc99ff4c7054545a10673afb2cf930b">tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member</nova:user>
Nov 22 16:01:39 user nova-compute[75734]:         <nova:project uuid="234cf12714b74b12aa027c8fff2e784e">tempest-ServerBootFromVolumeStableRescueTest-1333150873</nova:project>
Nov 22 16:01:39 user nova-compute[75734]:       </nova:owner>
Nov 22 16:01:39 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:01:39 user nova-compute[75734]:       <nova:ports>
Nov 22 16:01:39 user nova-compute[75734]:         <nova:port uuid="aade74b3-cd01-47c0-8443-2a1ae23343af">
Nov 22 16:01:39 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 16:01:39 user nova-compute[75734]:         </nova:port>
Nov 22 16:01:39 user nova-compute[75734]:       </nova:ports>
Nov 22 16:01:39 user nova-compute[75734]:     </nova:instance>
Nov 22 16:01:39 user nova-compute[75734]:   </metadata>
Nov 22 16:01:39 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:01:39 user nova-compute[75734]:     <system>
Nov 22 16:01:39 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:01:39 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:01:39 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:01:39 user nova-compute[75734]:       <entry name="serial">c76e93b4-c666-4a61-a09f-8ec45fee55d4</entry>
Nov 22 16:01:39 user nova-compute[75734]:       <entry name="uuid">c76e93b4-c666-4a61-a09f-8ec45fee55d4</entry>
Nov 22 16:01:39 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:01:39 user nova-compute[75734]:     </system>
Nov 22 16:01:39 user nova-compute[75734]:   </sysinfo>
Nov 22 16:01:39 user nova-compute[75734]:   <os>
Nov 22 16:01:39 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:01:39 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:01:39 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:01:39 user nova-compute[75734]:   </os>
Nov 22 16:01:39 user nova-compute[75734]:   <features>
Nov 22 16:01:39 user nova-compute[75734]:     <acpi/>
Nov 22 16:01:39 user nova-compute[75734]:     <apic/>
Nov 22 16:01:39 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:01:39 user nova-compute[75734]:   </features>
Nov 22 16:01:39 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:01:39 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:01:39 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:01:39 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:01:39 user nova-compute[75734]:   </clock>
Nov 22 16:01:39 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:01:39 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:01:39 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:01:39 user nova-compute[75734]:   </cpu>
Nov 22 16:01:39 user nova-compute[75734]:   <devices>
Nov 22 16:01:39 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:01:39 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:01:39 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk"/>
Nov 22 16:01:39 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:01:39 user nova-compute[75734]:     </disk>
Nov 22 16:01:39 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:01:39 user nova-compute[75734]:       <mac address="fa:16:3e:99:b1:44"/>
Nov 22 16:01:39 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:39 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:01:39 user nova-compute[75734]:       <target dev="tapaade74b3-cd"/>
Nov 22 16:01:39 user nova-compute[75734]:     </interface>
Nov 22 16:01:39 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:01:39 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/console.log" append="off"/>
Nov 22 16:01:39 user nova-compute[75734]:     </serial>
Nov 22 16:01:39 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:01:39 user nova-compute[75734]:     <video>
Nov 22 16:01:39 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:39 user nova-compute[75734]:     </video>
Nov 22 16:01:39 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:01:39 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:01:39 user nova-compute[75734]:     </rng>
Nov 22 16:01:39 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:01:39 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:01:39 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:01:39 user nova-compute[75734]:     </memballoon>
Nov 22 16:01:39 user nova-compute[75734]:   </devices>
Nov 22 16:01:39 user nova-compute[75734]: </domain>
Nov 22 16:01:39 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1861221698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1861221698',id=21,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-q441otei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:38Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=c76e93b4-c666-4a61-a09f-8ec45fee55d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b1:44,bridge_name='br-int',has_traffic_filtering=True,id=aade74b3-cd01-47c0-8443-2a1ae23343af,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaade74b3-cd') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG os_vif [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b1:44,bridge_name='br-int',has_traffic_filtering=True,id=aade74b3-cd01-47c0-8443-2a1ae23343af,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaade74b3-cd') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7da54f77-394a-50aa-a027-68a516ed9703', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaade74b3-cd, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaade74b3-cd, col_values=(('qos', UUID('feb5515c-2e5f-4934-9263-1b6ffe67214f')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaade74b3-cd, col_values=(('external_ids', {'iface-id': 'aade74b3-cd01-47c0-8443-2a1ae23343af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:b1:44', 'vm-uuid': 'c76e93b4-c666-4a61-a09f-8ec45fee55d4'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:39 user nova-compute[75734]: INFO os_vif [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b1:44,bridge_name='br-int',has_traffic_filtering=True,id=aade74b3-cd01-47c0-8443-2a1ae23343af,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaade74b3-cd')
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No VIF found with MAC fa:16:3e:99:b1:44, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Updated VIF entry in instance network info cache for port aade74b3-cd01-47c0-8443-2a1ae23343af. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Updating instance_info_cache with network_info: [{"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-26478a7d-be8c-4a84-a781-de0dc773cf84 req-93c2480e-90ba-4149-8a9d-949b73685353 service nova] Releasing lock "refresh_cache-c76e93b4-c666-4a61-a09f-8ec45fee55d4" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-3f416f0d-c3e3-4565-9ae3-e7b95ceb0e3f req-a500e862-24da-44f9-bdd1-3594234da29d service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received event network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f416f0d-c3e3-4565-9ae3-e7b95ceb0e3f req-a500e862-24da-44f9-bdd1-3594234da29d service nova] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f416f0d-c3e3-4565-9ae3-e7b95ceb0e3f req-a500e862-24da-44f9-bdd1-3594234da29d service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3f416f0d-c3e3-4565-9ae3-e7b95ceb0e3f req-a500e862-24da-44f9-bdd1-3594234da29d service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-3f416f0d-c3e3-4565-9ae3-e7b95ceb0e3f req-a500e862-24da-44f9-bdd1-3594234da29d service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] No waiting events found dispatching network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:41 user nova-compute[75734]: WARNING nova.compute.manager [req-3f416f0d-c3e3-4565-9ae3-e7b95ceb0e3f req-a500e862-24da-44f9-bdd1-3594234da29d service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received unexpected event network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af for instance with vm_state building and task_state spawning.
Nov 22 16:01:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:01:43 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Instance spawned successfully.
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-45ee18dc-fbe9-4e24-9b22-dbe9f2a1c246 req-e3f16b7b-5158-48f9-9c4b-869a30ed0205 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received event network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-45ee18dc-fbe9-4e24-9b22-dbe9f2a1c246 req-e3f16b7b-5158-48f9-9c4b-869a30ed0205 service nova] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-45ee18dc-fbe9-4e24-9b22-dbe9f2a1c246 req-e3f16b7b-5158-48f9-9c4b-869a30ed0205 service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-45ee18dc-fbe9-4e24-9b22-dbe9f2a1c246 req-e3f16b7b-5158-48f9-9c4b-869a30ed0205 service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-45ee18dc-fbe9-4e24-9b22-dbe9f2a1c246 req-e3f16b7b-5158-48f9-9c4b-869a30ed0205 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] No waiting events found dispatching network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:43 user nova-compute[75734]: WARNING nova.compute.manager [req-45ee18dc-fbe9-4e24-9b22-dbe9f2a1c246 req-e3f16b7b-5158-48f9-9c4b-869a30ed0205 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received unexpected event network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af for instance with vm_state building and task_state spawning.
Nov 22 16:01:43 user nova-compute[75734]: INFO nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 22 16:01:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:01:43 user nova-compute[75734]: INFO nova.compute.manager [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Took 6.32 seconds to build instance.
Nov 22 16:01:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-9d8d5371-044b-479a-9e18-f4d865e06ad7 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.418s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:01:48 user nova-compute[75734]: INFO nova.compute.claims [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Claim successful on node user
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.network.neutron [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:01:48 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.policy [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9891b862488466e8e46427bbd19f742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82865952d35349ffa829cf563d829fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:01:48 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Creating image(s)
Nov 22 16:01:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.079s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk 1073741824" returned: 0 in 0.059s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Successfully created port: 8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Cannot resize image /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Ensure instance console log exists: /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Successfully updated port: 8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquired lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-changed-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Refreshing instance network info cache due to event network-changed-8096492b-5d84-445a-8b97-d5bcbabef66c. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] Acquiring lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updating instance_info_cache with network_info: [{"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Releasing lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance network_info: |[{"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] Acquired lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.neutron [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Refreshing network info cache for port 8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Start _get_guest_xml network_info=[{"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:01:50 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:50 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-621823763',display_name='tempest-tempest.common.compute-instance-621823763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-621823763',id=22,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYitI8eNfB1WQDTrUNK8TBNh++AzBu18shj48L/hxhb5AEOAgsFIsMhpBNoR4suzzbEiyjKSGcIzZd665wV8TzuxDG7wFiixXZlqj4I6VD8gFswGXXpxAkFJiROJrAq6g==',key_name='tempest-keypair-1609171650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-6veorgxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=452d0048-4b11-40f4-b004-d7ded6232e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'pci_devices' on Instance uuid 452d0048-4b11-40f4-b004-d7ded6232e54 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:01:50 user nova-compute[75734]:   <uuid>452d0048-4b11-40f4-b004-d7ded6232e54</uuid>
Nov 22 16:01:50 user nova-compute[75734]:   <name>instance-00000016</name>
Nov 22 16:01:50 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:01:50 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:01:50 user nova-compute[75734]:   <metadata>
Nov 22 16:01:50 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:01:50 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:01:50 user nova-compute[75734]:       <nova:name>tempest-tempest.common.compute-instance-621823763</nova:name>
Nov 22 16:01:50 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:01:50</nova:creationTime>
Nov 22 16:01:50 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:01:50 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:01:50 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:01:50 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:01:50 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:01:50 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:01:50 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:01:50 user nova-compute[75734]:       <nova:owner>
Nov 22 16:01:50 user nova-compute[75734]:         <nova:user uuid="e9891b862488466e8e46427bbd19f742">tempest-ServerActionsTestOtherA-2146149591-project-member</nova:user>
Nov 22 16:01:50 user nova-compute[75734]:         <nova:project uuid="82865952d35349ffa829cf563d829fbe">tempest-ServerActionsTestOtherA-2146149591</nova:project>
Nov 22 16:01:50 user nova-compute[75734]:       </nova:owner>
Nov 22 16:01:50 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:01:50 user nova-compute[75734]:       <nova:ports>
Nov 22 16:01:50 user nova-compute[75734]:         <nova:port uuid="8096492b-5d84-445a-8b97-d5bcbabef66c">
Nov 22 16:01:50 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 16:01:50 user nova-compute[75734]:         </nova:port>
Nov 22 16:01:50 user nova-compute[75734]:       </nova:ports>
Nov 22 16:01:50 user nova-compute[75734]:     </nova:instance>
Nov 22 16:01:50 user nova-compute[75734]:   </metadata>
Nov 22 16:01:50 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:01:50 user nova-compute[75734]:     <system>
Nov 22 16:01:50 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:01:50 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:01:50 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:01:50 user nova-compute[75734]:       <entry name="serial">452d0048-4b11-40f4-b004-d7ded6232e54</entry>
Nov 22 16:01:50 user nova-compute[75734]:       <entry name="uuid">452d0048-4b11-40f4-b004-d7ded6232e54</entry>
Nov 22 16:01:50 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:01:50 user nova-compute[75734]:     </system>
Nov 22 16:01:50 user nova-compute[75734]:   </sysinfo>
Nov 22 16:01:50 user nova-compute[75734]:   <os>
Nov 22 16:01:50 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:01:50 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:01:50 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:01:50 user nova-compute[75734]:   </os>
Nov 22 16:01:50 user nova-compute[75734]:   <features>
Nov 22 16:01:50 user nova-compute[75734]:     <acpi/>
Nov 22 16:01:50 user nova-compute[75734]:     <apic/>
Nov 22 16:01:50 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:01:50 user nova-compute[75734]:   </features>
Nov 22 16:01:50 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:01:50 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:01:50 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:01:50 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:01:50 user nova-compute[75734]:   </clock>
Nov 22 16:01:50 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:01:50 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:01:50 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:01:50 user nova-compute[75734]:   </cpu>
Nov 22 16:01:50 user nova-compute[75734]:   <devices>
Nov 22 16:01:50 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:01:50 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:01:50 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk"/>
Nov 22 16:01:50 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:01:50 user nova-compute[75734]:     </disk>
Nov 22 16:01:50 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:01:50 user nova-compute[75734]:       <mac address="fa:16:3e:39:d8:f4"/>
Nov 22 16:01:50 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:50 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:01:50 user nova-compute[75734]:       <target dev="tap8096492b-5d"/>
Nov 22 16:01:50 user nova-compute[75734]:     </interface>
Nov 22 16:01:50 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:01:50 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/console.log" append="off"/>
Nov 22 16:01:50 user nova-compute[75734]:     </serial>
Nov 22 16:01:50 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:01:50 user nova-compute[75734]:     <video>
Nov 22 16:01:50 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:01:50 user nova-compute[75734]:     </video>
Nov 22 16:01:50 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:01:50 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:01:50 user nova-compute[75734]:     </rng>
Nov 22 16:01:50 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:01:50 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:01:50 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:01:50 user nova-compute[75734]:     </memballoon>
Nov 22 16:01:50 user nova-compute[75734]:   </devices>
Nov 22 16:01:50 user nova-compute[75734]: </domain>
Nov 22 16:01:50 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-621823763',display_name='tempest-tempest.common.compute-instance-621823763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-621823763',id=22,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYitI8eNfB1WQDTrUNK8TBNh++AzBu18shj48L/hxhb5AEOAgsFIsMhpBNoR4suzzbEiyjKSGcIzZd665wV8TzuxDG7wFiixXZlqj4I6VD8gFswGXXpxAkFJiROJrAq6g==',key_name='tempest-keypair-1609171650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-6veorgxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=452d0048-4b11-40f4-b004-d7ded6232e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG os_vif [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7137899-9b16-500c-b274-7c167eebd6d2', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8096492b-5d, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8096492b-5d, col_values=(('qos', UUID('e3897470-08cc-4d6f-9484-f11043abea7a')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8096492b-5d, col_values=(('external_ids', {'iface-id': '8096492b-5d84-445a-8b97-d5bcbabef66c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:d8:f4', 'vm-uuid': '452d0048-4b11-40f4-b004-d7ded6232e54'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:01:50 user nova-compute[75734]: INFO os_vif [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d')
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No VIF found with MAC fa:16:3e:39:d8:f4, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.neutron [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updated VIF entry in instance network info cache for port 8096492b-5d84-445a-8b97-d5bcbabef66c. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG nova.network.neutron [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updating instance_info_cache with network_info: [{"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4114bf32-b329-40e2-bb2c-0a07728a2c4b req-871ae82b-a8a8-4af2-8349-7a8d9d4cce4f service nova] Releasing lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-cdf50bc6-fa70-4104-a908-aa373cdcdc29 req-4bfc53a0-d6aa-4a15-abd4-fed104b6c70b service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cdf50bc6-fa70-4104-a908-aa373cdcdc29 req-4bfc53a0-d6aa-4a15-abd4-fed104b6c70b service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cdf50bc6-fa70-4104-a908-aa373cdcdc29 req-4bfc53a0-d6aa-4a15-abd4-fed104b6c70b service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cdf50bc6-fa70-4104-a908-aa373cdcdc29 req-4bfc53a0-d6aa-4a15-abd4-fed104b6c70b service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-cdf50bc6-fa70-4104-a908-aa373cdcdc29 req-4bfc53a0-d6aa-4a15-abd4-fed104b6c70b service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:52 user nova-compute[75734]: WARNING nova.compute.manager [req-cdf50bc6-fa70-4104-a908-aa373cdcdc29 req-4bfc53a0-d6aa-4a15-abd4-fed104b6c70b service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received unexpected event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with vm_state building and task_state spawning.
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:01:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance spawned successfully.
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-d72af6a2-7710-4c27-a380-96b5eed0f4a2 req-3ed564aa-560a-45ea-9237-48198f1f1a77 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d72af6a2-7710-4c27-a380-96b5eed0f4a2 req-3ed564aa-560a-45ea-9237-48198f1f1a77 service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d72af6a2-7710-4c27-a380-96b5eed0f4a2 req-3ed564aa-560a-45ea-9237-48198f1f1a77 service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d72af6a2-7710-4c27-a380-96b5eed0f4a2 req-3ed564aa-560a-45ea-9237-48198f1f1a77 service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-d72af6a2-7710-4c27-a380-96b5eed0f4a2 req-3ed564aa-560a-45ea-9237-48198f1f1a77 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:01:54 user nova-compute[75734]: WARNING nova.compute.manager [req-d72af6a2-7710-4c27-a380-96b5eed0f4a2 req-3ed564aa-560a-45ea-9237-48198f1f1a77 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received unexpected event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with vm_state building and task_state spawning.
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:54 user nova-compute[75734]: INFO nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 22 16:01:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:01:54 user nova-compute[75734]: INFO nova.compute.manager [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Took 6.28 seconds to build instance.
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-822a5861-406a-4b64-845f-2b3642f1df23 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.416s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-changed-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Refreshing instance network info cache due to event network-changed-1c2cc3c5-35f5-42ce-9652-a202016bd053. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] Acquiring lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] Acquired lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG nova.network.neutron [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Refreshing network info cache for port 1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:01:57 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:57 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7601MB free_disk=25.0418701171875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.network.neutron [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Updated VIF entry in instance network info cache for port 1c2cc3c5-35f5-42ce-9652-a202016bd053. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.network.neutron [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Updating instance_info_cache with network_info: [{"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b6040806-6924-4b4d-998e-d9324cc373e7 req-4037f061-385d-4b79-9dc4-08e02d62038d service nova] Releasing lock "refresh_cache-a9bd2406-f5bb-4f1e-bae4-c0654554ac88" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Applying migration context for instance 5dbde2ab-53f7-46db-a454-bcc8980833dc as it has an incoming, in-progress migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb. Migration status is finished {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 16:01:57 user nova-compute[75734]: INFO nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating resource usage from migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 820df13c-9f91-4a7a-a206-907e4f78817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 423a0127-0a4d-4a90-af6b-777bbd7080d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 452d0048-4b11-40f4-b004-d7ded6232e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:01:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:01:58 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:01:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:01:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:01:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'flavor' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:59 user nova-compute[75734]: INFO nova.compute.manager [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Attaching volume 6d41bf7f-f664-4884-8011-de8342796faa to /dev/vdb
Nov 22 16:01:59 user nova-compute[75734]: DEBUG os_brick.utils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362f68a-fac2-471e-a661-eba08cb0404f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec6dcb6-cb5a-4238-8e0e-e90846d9a3be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb93a4-541c-49cb-b3e3-c2e37a2898f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6083bf-e2e6-4675-8c9c-ecfe97f362e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:01:59 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9fc9e6-0c62-465e-9de8-9e9e25d6941f]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG os_brick.utils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating existing volume attachment record: 9c95fd63-5ce5-4849-be23-bf0fea717f79 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG nova.objects.instance [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid a9bd2406-f5bb-4f1e-bae4-c0654554ac88 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating instance_info_cache with network_info: [{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:01:59 user nova-compute[75734]: INFO nova.compute.manager [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Attaching volume 2056b2dc-f8f4-4eb0-9446-1a7a38096f3b to /dev/vdb
Nov 22 16:01:59 user nova-compute[75734]: DEBUG os_brick.utils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f086b9-65f7-4baa-81e4-fadd9987a545]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2fde41-e28c-48c4-8404-9a7501219e10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ded7e5e-0ea2-4e68-aee4-cac49b75f5d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e460d169-b49f-4a55-86e1-e0f41ef54512]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:01:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:02:00 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:02:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02179e1-4464-4716-a3a8-c197606c2192]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG os_brick.utils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Updating existing volume attachment record: 688322b7-feb6-4e3c-a874-26e53eee38e2 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:02:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEnbDNwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:02:06 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:02:06 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:02:06 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c069b8a-9bf6-40d3-8e11-826aef212fee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:02:06 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6475090c-c5a0-4e8f-8416-58c96b1c8efd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa] added
Nov 22 16:02:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b423ee6-9f19-43f6-8616-3c82756083f3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7188abe-a549-4cfd-a5d1-1800e34769fc]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEnbDNwW {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEnbDNwW" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[de99953d-01a3-45c9-abd9-f17ab7042ce6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xEnbDNwW'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f48b4a-a1d6-4ad6-bd4f-b0ef89f3f7c9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d208b0-1018-4482-bc53-ebcfc89daf6f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:06 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:06 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a42e8-35ac-4c79-8870-67708c27985b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260]
Nov 22 16:02:06 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260] successful.
Nov 22 16:02:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[025dd397-b6ea-41f1-9b72-bf36ec46a6f4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeec56e-c9a2-4cb9-9857-b05fd071c22b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:06 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:06 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:06 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:06 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:06 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ac1c8b-b0d5-4a2d-ae49-596f7706ba1b]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EawGryom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:02:06 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:02:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEnbDNwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23434323636663663', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434323636663663', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.859s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:02:07 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:02:07 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'flavor' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6720ae0-7dfc-489c-bfde-35570275ad3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:02:07 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[89edc6c7-27b4-4bf5-8c9e-72948fb860f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b] added
Nov 22 16:02:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:02:07 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:02:07 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:02:07 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:02:07 user nova-compute[75734]:   <serial>6d41bf7f-f664-4884-8011-de8342796faa</serial>
Nov 22 16:02:07 user nova-compute[75734]: </disk>
Nov 22 16:02:07 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[06793f57-5ba3-4531-b013-810101371d0a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[33204afe-bb86-41b3-add4-2fb0961f74c8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EawGryom {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EawGryom" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4592ee0-bee1-4467-8710-f99bb7c2b4fa]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EawGryom'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7075b4b-b95e-477b-a658-2b6dce7775d7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa95da98-4708-4aaa-b941-bf387d65bdab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e8cd68-c4fc-4e34-b13e-e9764fd53d41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260]
Nov 22 16:02:07 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260] successful.
Nov 22 16:02:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe247a80-ca83-4854-9139-0dae99558872]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[549da6eb-fef7-4d20-9499-b103fa37c59c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:02:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:07 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:02:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[73792b17-145e-401f-9593-b2dd7625ab6a]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No VIF found with MAC fa:16:3e:f7:34:18, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea8b232c-4d21-480a-828f-b7d9a2890b45 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.813s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EawGryom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== connect_volume: return (2200ms) {'type': 'block', 'scsi_wwn': '23634303238646334', 'path': '/dev/sde'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634303238646334', 'path': '/dev/sde'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG nova.objects.instance [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid a9bd2406-f5bb-4f1e-bae4-c0654554ac88 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:02:08 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:02:08 user nova-compute[75734]:   <source dev="/dev/sde"/>
Nov 22 16:02:08 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:02:08 user nova-compute[75734]:   <serial>2056b2dc-f8f4-4eb0-9446-1a7a38096f3b</serial>
Nov 22 16:02:08 user nova-compute[75734]: </disk>
Nov 22 16:02:08 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No VIF found with MAC fa:16:3e:da:48:86, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:02:09 user nova-compute[75734]: INFO nova.compute.manager [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Rescuing
Nov 22 16:02:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-629e8f79-284e-4598-902a-60ea2a57bb5e tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.586s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-0cef2b3a-7507-4782-9011-30ab97a73ccf req-726f32dc-0af3-4884-a763-5a7ce469b902 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0cef2b3a-7507-4782-9011-30ab97a73ccf req-726f32dc-0af3-4884-a763-5a7ce469b902 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0cef2b3a-7507-4782-9011-30ab97a73ccf req-726f32dc-0af3-4884-a763-5a7ce469b902 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0cef2b3a-7507-4782-9011-30ab97a73ccf req-726f32dc-0af3-4884-a763-5a7ce469b902 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-0cef2b3a-7507-4782-9011-30ab97a73ccf req-726f32dc-0af3-4884-a763-5a7ce469b902 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:02:10 user nova-compute[75734]: WARNING nova.compute.manager [req-0cef2b3a-7507-4782-9011-30ab97a73ccf req-726f32dc-0af3-4884-a763-5a7ce469b902 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state active and task_state rescuing.
Nov 22 16:02:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance destroyed successfully.
Nov 22 16:02:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Attempting a stable device rescue
Nov 22 16:02:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75734) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 16:02:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Creating image(s)
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'trusted_certs' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "bf5d9b3bf83440840287bb02688bcfa869106c75" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "bf5d9b3bf83440840287bb02688bcfa869106c75" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:11 user nova-compute[75734]: DEBUG nova.virt.images [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] 9f715230-dfad-4349-ae47-6ce0698e3a4b was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 16:02:11 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:02:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.part /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-569af707-8b44-4fbb-a47e-a0e968d8172a req-ffc6d977-9792-4d58-973d-bc8594db86de service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-569af707-8b44-4fbb-a47e-a0e968d8172a req-ffc6d977-9792-4d58-973d-bc8594db86de service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-569af707-8b44-4fbb-a47e-a0e968d8172a req-ffc6d977-9792-4d58-973d-bc8594db86de service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-569af707-8b44-4fbb-a47e-a0e968d8172a req-ffc6d977-9792-4d58-973d-bc8594db86de service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-569af707-8b44-4fbb-a47e-a0e968d8172a req-ffc6d977-9792-4d58-973d-bc8594db86de service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:02:12 user nova-compute[75734]: WARNING nova.compute.manager [req-569af707-8b44-4fbb-a47e-a0e968d8172a req-ffc6d977-9792-4d58-973d-bc8594db86de service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state active and task_state rescuing.
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "465edf8b-56b2-4788-85fb-525665ff16d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "465edf8b-56b2-4788-85fb-525665ff16d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.part /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.converted" returned: 0 in 0.589s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:02:12 user nova-compute[75734]: INFO nova.compute.claims [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Claim successful on node user
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "bf5d9b3bf83440840287bb02688bcfa869106c75" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.893s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "bf5d9b3bf83440840287bb02688bcfa869106c75" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "bf5d9b3bf83440840287bb02688bcfa869106c75" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75,backing_fmt=raw /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75,backing_fmt=raw /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue" returned: 0 in 0.050s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "bf5d9b3bf83440840287bb02688bcfa869106c75" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'migration_context' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.objects.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Object Instance<820df13c-9f91-4a7a-a206-907e4f78817b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Start _get_guest_xml network_info=[{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "vif_mac": "fa:16:3e:f7:34:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9f715230-dfad-4349-ae47-6ce0698e3a4b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9c95fd63-5ce5-4849-be23-bf0fea717f79', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEnbDNwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '820df13c-9f91-4a7a-a206-907e4f78817b', 'attached_at': '', 'detached_at': '', 'volume_id': '6d41bf7f-f664-4884-8011-de8342796faa', 'serial': '6d41bf7f-f664-4884-8011-de8342796faa'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'resources' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.objects.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Object Instance<820df13c-9f91-4a7a-a206-907e4f78817b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'numa_topology' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:12 user nova-compute[75734]: DEBUG nova.objects.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Object Instance<820df13c-9f91-4a7a-a206-907e4f78817b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:02:13 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:02:13 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.objects.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Object Instance<820df13c-9f91-4a7a-a206-907e4f78817b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEnbDNwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:02:13 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:02:13 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:02:13 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[616d3aa4-30ad-4e71-b521-addec637d550]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xEnbDNwW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 16:02:13 user nova-compute[75734]: node.name = iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa
Nov 22 16:02:13 user nova-compute[75734]: node.tpgt = -1
Nov 22 16:02:13 user nova-compute[75734]: node.startup = automatic
Nov 22 16:02:13 user nova-compute[75734]: node.leading_login = No
Nov 22 16:02:13 user nova-compute[75734]: iface.iscsi_ifacename = default
Nov 22 16:02:13 user nova-compute[75734]: iface.net_ifacename = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.ipaddress = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.prefix_len = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.hwaddress = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.transport_name = tcp
Nov 22 16:02:13 user nova-compute[75734]: iface.initiatorname = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.state = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.vlan_id = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.vlan_priority = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.vlan_state = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.iface_num = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.mtu = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.port = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.bootproto = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.subnet_mask = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.gateway = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_alt_client_id = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_dns = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_learn_iqn = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_vendor_id_state = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_vendor_id = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.dhcp_slp_da = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.fragmentation = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.gratuitous_arp = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.incoming_forwarding = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.tos_state = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.tos = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.ttl = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.delayed_ack = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.tcp_nagle = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.tcp_wsf_state = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.tcp_wsf = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.tcp_timer_scale = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.tcp_timestamp = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.redirect = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.def_task_mgmt_timeout = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.header_digest = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.data_digest = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.immediate_data = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.initial_r2t = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.data_seq_inorder = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.data_pdu_inorder = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.erl = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.max_receive_data_len = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.first_burst_len = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.max_outstanding_r2t = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.max_burst_len = 0
Nov 22 16:02:13 user nova-compute[75734]: iface.chap_auth = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.bidi_chap = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.strict_login_compliance = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.discovery_auth = <empty>
Nov 22 16:02:13 user nova-compute[75734]: iface.discovery_logout = <empty>
Nov 22 16:02:13 user nova-compute[75734]: node.discovery_address = <empty>
Nov 22 16:02:13 user nova-compute[75734]: node.discovery_port = 0
Nov 22 16:02:13 user nova-compute[75734]: node.discovery_type = static
Nov 22 16:02:13 user nova-compute[75734]: node.session.initial_cmdsn = 0
Nov 22 16:02:13 user nova-compute[75734]: node.session.initial_login_retry_max = 8
Nov 22 16:02:13 user nova-compute[75734]: node.session.xmit_thread_priority = -20
Nov 22 16:02:13 user nova-compute[75734]: node.session.cmds_max = 128
Nov 22 16:02:13 user nova-compute[75734]: node.session.queue_depth = 32
Nov 22 16:02:13 user nova-compute[75734]: node.session.nr_sessions = 1
Nov 22 16:02:13 user nova-compute[75734]: node.session.auth.authmethod = CHAP
Nov 22 16:02:13 user nova-compute[75734]: node.session.auth.username = xEnbDNwW
Nov 22 16:02:13 user nova-compute[75734]: node.session.auth.password = ***
Nov 22 16:02:13 user nova-compute[75734]: node.session.auth.username_in = <empty>
Nov 22 16:02:13 user nova-compute[75734]: node.session.auth.password_in = <empty>
Nov 22 16:02:13 user nova-compute[75734]: node.session.auth.chap_algs = MD5
Nov 22 16:02:13 user nova-compute[75734]: node.session.timeo.replacement_timeout = 120
Nov 22 16:02:13 user nova-compute[75734]: node.session.err_timeo.abort_timeout = 15
Nov 22 16:02:13 user nova-compute[75734]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 16:02:13 user nova-compute[75734]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 16:02:13 user nova-compute[75734]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.FastAbort = Yes
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.InitialR2T = No
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.ImmediateData = Yes
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.MaxConnections = 1
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 16:02:13 user nova-compute[75734]: node.session.iscsi.ERL = 0
Nov 22 16:02:13 user nova-compute[75734]: node.session.scan = manual
Nov 22 16:02:13 user nova-compute[75734]: node.session.reopen_max = 0
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].address = 172.16.0.220
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].port = 3260
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].startup = manual
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].tcp.window_size = 524288
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].tcp.type_of_service = 0
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].timeo.logout_timeout = 15
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].timeo.login_timeout = 15
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].timeo.auth_timeout = 45
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].iscsi.DataDigest = None
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].iscsi.IFMarker = No
Nov 22 16:02:13 user nova-compute[75734]: node.conn[0].iscsi.OFMarker = No
Nov 22 16:02:13 user nova-compute[75734]: # END RECORD
Nov 22 16:02:13 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[86124591-bd07-4490-a1b1-e6f8df2143e1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f937d3-a1fd-4fe6-8156-ae760aebc4c8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEnbDNwW {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEnbDNwW" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d292bd1-af79-4786-89fd-25c607820cc8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xEnbDNwW'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff322490-46d0-4870-97bb-e6d34880a036]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a623587d-bacf-49a6-bdd2-988a1c2c63ef]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:13 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:13 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:13 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:02:13 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:02:13 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:02:13 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:02:13 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:02:13 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] HCTL ('34', '0', '0', 0) found on session 23 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af18bde-d28b-4270-a2a5-9009d32ab9f5]: (4, ('0 0 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Searching for a device in session 23 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEnbDNwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.208s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23434323636663663', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434323636663663', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1965206383',display_name='tempest-ServerStableDeviceRescueTest-server-1965206383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1965206383',id=17,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUk2XbUSRZkPVQX50ldN8fglFEZrOrx6bWFhvyl1nOEoIPJXUueaINERYMALQvtH7Yjd1nNJqLOm5HiLTN9Fahitj0OaOxYevgY2rTMJMdhFvy54R+Qnw3LFF1LeYoI7Q==',key_name='tempest-keypair-1287154213',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:58:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7cf712589524e98b21c4bbc6ff7e8b6',ramdisk_id='',reservation_id='r-2lxxk9sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1050690507',owner_user_name='tempest-ServerStableDeviceRescueTest-1050690507-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5dd895a5e6e4c10a1a99a172d47b189',uuid=820df13c-9f91-4a7a-a206-907e4f78817b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "vif_mac": "fa:16:3e:f7:34:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converting VIF {"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "vif_mac": "fa:16:3e:f7:34:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'pci_devices' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.policy [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb5b3c03bbb490f9ef6f3f9c70bf9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7d5b5135ca46c2a649df3c1ce2ac64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.objects.base [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Object Instance<820df13c-9f91-4a7a-a206-907e4f78817b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:02:13 user nova-compute[75734]:   <uuid>820df13c-9f91-4a7a-a206-907e4f78817b</uuid>
Nov 22 16:02:13 user nova-compute[75734]:   <name>instance-00000011</name>
Nov 22 16:02:13 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:02:13 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:02:13 user nova-compute[75734]:   <metadata>
Nov 22 16:02:13 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:02:13 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:02:13 user nova-compute[75734]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1965206383</nova:name>
Nov 22 16:02:13 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:02:13</nova:creationTime>
Nov 22 16:02:13 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:02:13 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:02:13 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:02:13 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:02:13 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:02:13 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:02:13 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:02:13 user nova-compute[75734]:       <nova:owner>
Nov 22 16:02:13 user nova-compute[75734]:         <nova:user uuid="f5dd895a5e6e4c10a1a99a172d47b189">tempest-ServerStableDeviceRescueTest-1050690507-project-member</nova:user>
Nov 22 16:02:13 user nova-compute[75734]:         <nova:project uuid="a7cf712589524e98b21c4bbc6ff7e8b6">tempest-ServerStableDeviceRescueTest-1050690507</nova:project>
Nov 22 16:02:13 user nova-compute[75734]:       </nova:owner>
Nov 22 16:02:13 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:02:13 user nova-compute[75734]:       <nova:ports>
Nov 22 16:02:13 user nova-compute[75734]:         <nova:port uuid="fccdef99-6171-4f48-8296-4e814cf583bb">
Nov 22 16:02:13 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 16:02:13 user nova-compute[75734]:         </nova:port>
Nov 22 16:02:13 user nova-compute[75734]:       </nova:ports>
Nov 22 16:02:13 user nova-compute[75734]:     </nova:instance>
Nov 22 16:02:13 user nova-compute[75734]:   </metadata>
Nov 22 16:02:13 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:02:13 user nova-compute[75734]:     <system>
Nov 22 16:02:13 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:02:13 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:02:13 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:02:13 user nova-compute[75734]:       <entry name="serial">820df13c-9f91-4a7a-a206-907e4f78817b</entry>
Nov 22 16:02:13 user nova-compute[75734]:       <entry name="uuid">820df13c-9f91-4a7a-a206-907e4f78817b</entry>
Nov 22 16:02:13 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:02:13 user nova-compute[75734]:     </system>
Nov 22 16:02:13 user nova-compute[75734]:   </sysinfo>
Nov 22 16:02:13 user nova-compute[75734]:   <os>
Nov 22 16:02:13 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:02:13 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:02:13 user nova-compute[75734]:   </os>
Nov 22 16:02:13 user nova-compute[75734]:   <features>
Nov 22 16:02:13 user nova-compute[75734]:     <acpi/>
Nov 22 16:02:13 user nova-compute[75734]:     <apic/>
Nov 22 16:02:13 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:02:13 user nova-compute[75734]:   </features>
Nov 22 16:02:13 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:02:13 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:02:13 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:02:13 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:02:13 user nova-compute[75734]:   </clock>
Nov 22 16:02:13 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:02:13 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:02:13 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:02:13 user nova-compute[75734]:   </cpu>
Nov 22 16:02:13 user nova-compute[75734]:   <devices>
Nov 22 16:02:13 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:02:13 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:02:13 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk"/>
Nov 22 16:02:13 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:02:13 user nova-compute[75734]:     </disk>
Nov 22 16:02:13 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:02:13 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:02:13 user nova-compute[75734]:       <source dev="/dev/sdc"/>
Nov 22 16:02:13 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:02:13 user nova-compute[75734]:       <serial>6d41bf7f-f664-4884-8011-de8342796faa</serial>
Nov 22 16:02:13 user nova-compute[75734]:     </disk>
Nov 22 16:02:13 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:02:13 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:02:13 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue"/>
Nov 22 16:02:13 user nova-compute[75734]:       <target dev="vdc" bus="virtio"/>
Nov 22 16:02:13 user nova-compute[75734]:       <boot order="1"/>
Nov 22 16:02:13 user nova-compute[75734]:     </disk>
Nov 22 16:02:13 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:02:13 user nova-compute[75734]:       <mac address="fa:16:3e:f7:34:18"/>
Nov 22 16:02:13 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:02:13 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:02:13 user nova-compute[75734]:       <target dev="tapfccdef99-61"/>
Nov 22 16:02:13 user nova-compute[75734]:     </interface>
Nov 22 16:02:13 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:02:13 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/console.log" append="off"/>
Nov 22 16:02:13 user nova-compute[75734]:     </serial>
Nov 22 16:02:13 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:02:13 user nova-compute[75734]:     <video>
Nov 22 16:02:13 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:02:13 user nova-compute[75734]:     </video>
Nov 22 16:02:13 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:02:13 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:02:13 user nova-compute[75734]:     </rng>
Nov 22 16:02:13 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:02:13 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:02:13 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:02:13 user nova-compute[75734]:     </memballoon>
Nov 22 16:02:13 user nova-compute[75734]:   </devices>
Nov 22 16:02:13 user nova-compute[75734]: </domain>
Nov 22 16:02:13 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:02:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance destroyed successfully.
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:02:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Creating image(s)
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "/opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] No VIF found with MAC fa:16:3e:f7:34:18, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk 1073741824" returned: 0 in 0.050s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Successfully created port: f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Cannot resize image /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Ensure instance console log exists: /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Successfully updated port: f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquired lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-changed-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Refreshing instance network info cache due to event network-changed-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] Acquiring lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.compute.manager [req-99ee2000-3495-4e42-b590-53b8fcc5436a req-a12141c2-5da0-4181-996e-37dbff5cb0c9 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-99ee2000-3495-4e42-b590-53b8fcc5436a req-a12141c2-5da0-4181-996e-37dbff5cb0c9 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-99ee2000-3495-4e42-b590-53b8fcc5436a req-a12141c2-5da0-4181-996e-37dbff5cb0c9 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-99ee2000-3495-4e42-b590-53b8fcc5436a req-a12141c2-5da0-4181-996e-37dbff5cb0c9 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.compute.manager [req-99ee2000-3495-4e42-b590-53b8fcc5436a req-a12141c2-5da0-4181-996e-37dbff5cb0c9 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:02:15 user nova-compute[75734]: WARNING nova.compute.manager [req-99ee2000-3495-4e42-b590-53b8fcc5436a req-a12141c2-5da0-4181-996e-37dbff5cb0c9 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state active and task_state rescuing.
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Updating instance_info_cache with network_info: [{"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Releasing lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Instance network_info: |[{"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] Acquired lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Refreshing network info cache for port f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Start _get_guest_xml network_info=[{"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:02:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:02:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1994107507',display_name='tempest-AttachVolumeNegativeTest-server-1994107507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1994107507',id=23,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUD2YF+nAC2wztUNKZL4XD+YWgk+4tHQGfQ4vITDgE44dXR8bmNNBvEIatnyF7QH+XhWHwVw2eyoklDeo/3TwaQHUvDG+nISfTyb8T2bAffUBxfUdGzAqbK5W0Fy1q73A==',key_name='tempest-keypair-575190232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-nieql5a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=465edf8b-56b2-4788-85fb-525665ff16d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ab:dc,bridge_name='br-int',has_traffic_filtering=True,id=f3c4b4c5-a556-4ec6-bbee-de8b081a38c1,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c4b4c5-a5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'pci_devices' on Instance uuid 465edf8b-56b2-4788-85fb-525665ff16d5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:02:15 user nova-compute[75734]:   <uuid>465edf8b-56b2-4788-85fb-525665ff16d5</uuid>
Nov 22 16:02:15 user nova-compute[75734]:   <name>instance-00000017</name>
Nov 22 16:02:15 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:02:15 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:02:15 user nova-compute[75734]:   <metadata>
Nov 22 16:02:15 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:02:15 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:02:15 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1994107507</nova:name>
Nov 22 16:02:15 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:02:15</nova:creationTime>
Nov 22 16:02:15 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:02:15 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:02:15 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:02:15 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:02:15 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:02:15 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:02:15 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:02:15 user nova-compute[75734]:       <nova:owner>
Nov 22 16:02:15 user nova-compute[75734]:         <nova:user uuid="abb5b3c03bbb490f9ef6f3f9c70bf9d2">tempest-AttachVolumeNegativeTest-2104845353-project-member</nova:user>
Nov 22 16:02:15 user nova-compute[75734]:         <nova:project uuid="cb7d5b5135ca46c2a649df3c1ce2ac64">tempest-AttachVolumeNegativeTest-2104845353</nova:project>
Nov 22 16:02:15 user nova-compute[75734]:       </nova:owner>
Nov 22 16:02:15 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:02:15 user nova-compute[75734]:       <nova:ports>
Nov 22 16:02:15 user nova-compute[75734]:         <nova:port uuid="f3c4b4c5-a556-4ec6-bbee-de8b081a38c1">
Nov 22 16:02:15 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 16:02:15 user nova-compute[75734]:         </nova:port>
Nov 22 16:02:15 user nova-compute[75734]:       </nova:ports>
Nov 22 16:02:15 user nova-compute[75734]:     </nova:instance>
Nov 22 16:02:15 user nova-compute[75734]:   </metadata>
Nov 22 16:02:15 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:02:15 user nova-compute[75734]:     <system>
Nov 22 16:02:15 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:02:15 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:02:15 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:02:15 user nova-compute[75734]:       <entry name="serial">465edf8b-56b2-4788-85fb-525665ff16d5</entry>
Nov 22 16:02:15 user nova-compute[75734]:       <entry name="uuid">465edf8b-56b2-4788-85fb-525665ff16d5</entry>
Nov 22 16:02:15 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:02:15 user nova-compute[75734]:     </system>
Nov 22 16:02:15 user nova-compute[75734]:   </sysinfo>
Nov 22 16:02:15 user nova-compute[75734]:   <os>
Nov 22 16:02:15 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:02:15 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:02:15 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:02:15 user nova-compute[75734]:   </os>
Nov 22 16:02:15 user nova-compute[75734]:   <features>
Nov 22 16:02:15 user nova-compute[75734]:     <acpi/>
Nov 22 16:02:15 user nova-compute[75734]:     <apic/>
Nov 22 16:02:15 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:02:15 user nova-compute[75734]:   </features>
Nov 22 16:02:15 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:02:15 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:02:15 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:02:15 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:02:15 user nova-compute[75734]:   </clock>
Nov 22 16:02:15 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:02:15 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:02:15 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:02:15 user nova-compute[75734]:   </cpu>
Nov 22 16:02:15 user nova-compute[75734]:   <devices>
Nov 22 16:02:15 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:02:15 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:02:15 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk"/>
Nov 22 16:02:15 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:02:15 user nova-compute[75734]:     </disk>
Nov 22 16:02:15 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:02:15 user nova-compute[75734]:       <mac address="fa:16:3e:e1:ab:dc"/>
Nov 22 16:02:15 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:02:15 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:02:15 user nova-compute[75734]:       <target dev="tapf3c4b4c5-a5"/>
Nov 22 16:02:15 user nova-compute[75734]:     </interface>
Nov 22 16:02:15 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:02:15 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/console.log" append="off"/>
Nov 22 16:02:15 user nova-compute[75734]:     </serial>
Nov 22 16:02:15 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:02:15 user nova-compute[75734]:     <video>
Nov 22 16:02:15 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:02:15 user nova-compute[75734]:     </video>
Nov 22 16:02:15 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:02:15 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:02:15 user nova-compute[75734]:     </rng>
Nov 22 16:02:15 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:02:15 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:02:15 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:02:15 user nova-compute[75734]:     </memballoon>
Nov 22 16:02:15 user nova-compute[75734]:   </devices>
Nov 22 16:02:15 user nova-compute[75734]: </domain>
Nov 22 16:02:15 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1994107507',display_name='tempest-AttachVolumeNegativeTest-server-1994107507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1994107507',id=23,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUD2YF+nAC2wztUNKZL4XD+YWgk+4tHQGfQ4vITDgE44dXR8bmNNBvEIatnyF7QH+XhWHwVw2eyoklDeo/3TwaQHUvDG+nISfTyb8T2bAffUBxfUdGzAqbK5W0Fy1q73A==',key_name='tempest-keypair-575190232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-nieql5a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=465edf8b-56b2-4788-85fb-525665ff16d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ab:dc,bridge_name='br-int',has_traffic_filtering=True,id=f3c4b4c5-a556-4ec6-bbee-de8b081a38c1,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c4b4c5-a5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG os_vif [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ab:dc,bridge_name='br-int',has_traffic_filtering=True,id=f3c4b4c5-a556-4ec6-bbee-de8b081a38c1,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c4b4c5-a5') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4373f011-8643-53a5-8e25-0894831df8bb', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3c4b4c5-a5, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3c4b4c5-a5, col_values=(('qos', UUID('0a4ba329-a778-4dba-897d-94bfb49097b8')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3c4b4c5-a5, col_values=(('external_ids', {'iface-id': 'f3c4b4c5-a556-4ec6-bbee-de8b081a38c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:ab:dc', 'vm-uuid': '465edf8b-56b2-4788-85fb-525665ff16d5'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: INFO os_vif [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ab:dc,bridge_name='br-int',has_traffic_filtering=True,id=f3c4b4c5-a556-4ec6-bbee-de8b081a38c1,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c4b4c5-a5')
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No VIF found with MAC fa:16:3e:e1:ab:dc, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Updated VIF entry in instance network info cache for port f3c4b4c5-a556-4ec6-bbee-de8b081a38c1. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Updating instance_info_cache with network_info: [{"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:02:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-052ed051-fa98-4908-b351-b32d3d52a25b req-58553888-5e38-4774-bde4-c66c65c685e6 service nova] Releasing lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:02:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-22c52773-a277-4f84-9e1c-314f185b6a88 req-3fed1a99-b9e7-40b7-8997-090503c9d6e9 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-22c52773-a277-4f84-9e1c-314f185b6a88 req-3fed1a99-b9e7-40b7-8997-090503c9d6e9 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-22c52773-a277-4f84-9e1c-314f185b6a88 req-3fed1a99-b9e7-40b7-8997-090503c9d6e9 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-22c52773-a277-4f84-9e1c-314f185b6a88 req-3fed1a99-b9e7-40b7-8997-090503c9d6e9 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-22c52773-a277-4f84-9e1c-314f185b6a88 req-3fed1a99-b9e7-40b7-8997-090503c9d6e9 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:02:17 user nova-compute[75734]: WARNING nova.compute.manager [req-22c52773-a277-4f84-9e1c-314f185b6a88 req-3fed1a99-b9e7-40b7-8997-090503c9d6e9 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state active and task_state rescuing.
Nov 22 16:02:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b18c0d89-a924-479e-a589-4aa87e9096d3 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:02:19 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Instance spawned successfully.
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:02:19 user nova-compute[75734]: INFO nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:02:19 user nova-compute[75734]: INFO nova.compute.manager [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Took 7.02 seconds to build instance.
Nov 22 16:02:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ebda7da5-107b-4249-a681-fe4622a9d505 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "465edf8b-56b2-4788-85fb-525665ff16d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.185s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] Acquiring lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] No waiting events found dispatching network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:02:19 user nova-compute[75734]: WARNING nova.compute.manager [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received unexpected event network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 for instance with vm_state building and task_state spawning.
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] Acquiring lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] No waiting events found dispatching network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:02:19 user nova-compute[75734]: WARNING nova.compute.manager [req-d0f90450-2e63-441e-b358-56638989385f req-45f0cbdd-590c-42e2-a7aa-aeaed7bdc1f1 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received unexpected event network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 for instance with vm_state building and task_state spawning.
Nov 22 16:02:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:02:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:02:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:02:57 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:02:57 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7229MB free_disk=24.820240020751953GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Applying migration context for instance 5dbde2ab-53f7-46db-a454-bcc8980833dc as it has an incoming, in-progress migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb. Migration status is finished {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 16:02:57 user nova-compute[75734]: INFO nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating resource usage from migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 820df13c-9f91-4a7a-a206-907e4f78817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 423a0127-0a4d-4a90-af6b-777bbd7080d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 452d0048-4b11-40f4-b004-d7ded6232e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 465edf8b-56b2-4788-85fb-525665ff16d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:02:57 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:02:58 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:02:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:02:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:02:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:02:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:02:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:02:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:02:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:02:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Port 15e6a34b-4d97-4ae0-849e-8f64c4043ddd binding to destination host user is already ACTIVE {{(pid=75734) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Creating tmpfile /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/tmp_475bep5 to verify with other compute node that the instance is on the same shared storage. {{(pid=75734) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-7ca08de9-014b-4041-9094-a443b739b298 req-cd609634-bd23-4ad6-a8b3-6e16448344f7 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7ca08de9-014b-4041-9094-a443b739b298 req-cd609634-bd23-4ad6-a8b3-6e16448344f7 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7ca08de9-014b-4041-9094-a443b739b298 req-cd609634-bd23-4ad6-a8b3-6e16448344f7 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7ca08de9-014b-4041-9094-a443b739b298 req-cd609634-bd23-4ad6-a8b3-6e16448344f7 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-7ca08de9-014b-4041-9094-a443b739b298 req-cd609634-bd23-4ad6-a8b3-6e16448344f7 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:00 user nova-compute[75734]: WARNING nova.compute.manager [req-7ca08de9-014b-4041-9094-a443b739b298 req-cd609634-bd23-4ad6-a8b3-6e16448344f7 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state resized and task_state resize_reverting.
Nov 22 16:03:01 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance destroyed successfully.
Nov 22 16:03:01 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lazy-loading 'resources' on Instance uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_vif [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e6a34b-4d, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2773bda-9085-44e9-8474-b78194c409f4) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:01 user nova-compute[75734]: INFO os_vif [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d')
Nov 22 16:03:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:01 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e676623-d719-4683-9b0e-f73f4b015260]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:03:01 user nova-compute[75734]: No targets found.
Nov 22 16:03:01 user nova-compute[75734]: iSNS:
Nov 22 16:03:01 user nova-compute[75734]: No targets found.
Nov 22 16:03:01 user nova-compute[75734]: STATIC:
Nov 22 16:03:01 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:03:01 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:01 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:01 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:03:01 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:01 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:01 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa
Nov 22 16:03:01 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:01 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:01 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b
Nov 22 16:03:01 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:01 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:01 user nova-compute[75734]: FIRMWARE:
Nov 22 16:03:01 user nova-compute[75734]: No targets found.
Nov 22 16:03:01 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:03:01 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:03:01 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7901694-6c25-4877-9712-c4d5da30efd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aab594-0517-4cd5-8932-28626e5797ca]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:01 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:01 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:01 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:01 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:01 user nova-compute[75734]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:01 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:01 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:01 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc6d70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3eed6-3c7a-4227-8082-0b07160e1a74]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7f50b4-83aa-4aab-a0d5-44fc0c4aa22c]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02f86bd-a3f9-4da8-9a64-10dc66b07053]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fcbcfe-c7be-4f4a-a2b7-3fe7b242d44c]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[178e2327-f6ab-4aec-af89-fe5ae27bc986]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c856b49-6388-41c8-84d1-d2fe2d50e50a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]
Nov 22 16:03:01 user nova-compute[75734]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.
Nov 22 16:03:01 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f218df6c-2480-494e-b543-17815ef81280]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== disconnect_volume: return (298ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:03:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-962e3028-ea94-4e81-a6e0-478e6bb06b72 req-f11b03ab-a423-4801-8e19-0f4ec64b8ff9 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-962e3028-ea94-4e81-a6e0-478e6bb06b72 req-f11b03ab-a423-4801-8e19-0f4ec64b8ff9 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-962e3028-ea94-4e81-a6e0-478e6bb06b72 req-f11b03ab-a423-4801-8e19-0f4ec64b8ff9 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-962e3028-ea94-4e81-a6e0-478e6bb06b72 req-f11b03ab-a423-4801-8e19-0f4ec64b8ff9 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-962e3028-ea94-4e81-a6e0-478e6bb06b72 req-f11b03ab-a423-4801-8e19-0f4ec64b8ff9 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:03 user nova-compute[75734]: WARNING nova.compute.manager [req-962e3028-ea94-4e81-a6e0-478e6bb06b72 req-f11b03ab-a423-4801-8e19-0f4ec64b8ff9 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state resized and task_state resize_reverting.
Nov 22 16:03:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:04 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lazy-loading 'migration_context' on Instance uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:04 user nova-compute[75734]: DEBUG nova.objects.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Object Instance<5dbde2ab-53f7-46db-a454-bcc8980833dc> lazy-loaded attributes: resources,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:03:04 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:03:04 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:03:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.516s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:04 user nova-compute[75734]: INFO nova.compute.manager [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Swapping old allocation on dict_keys(['37d0620c-15f4-4d5b-869d-cafca8d2e0e2']) held by migration 3d4efe6f-4c2a-4828-a030-6e86e59b09cb for instance
Nov 22 16:03:04 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Overwriting current allocation {'allocations': {'37d0620c-15f4-4d5b-869d-cafca8d2e0e2': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 27}}, 'project_id': '5d179eb8ada444378bb4412630b6e12a', 'user_id': '4b585828df0c4d2786a02ff5621a0732', 'consumer_generation': 1} on consumer 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquired lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Releasing lock "refresh_cache-5dbde2ab-53f7-46db-a454-bcc8980833dc" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG os_brick.utils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1257a76-7112-4d47-b8dc-03b5c087ef27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f12a735-e79b-4df6-abe3-df23c26c666b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb6fda3-a60a-454f-a0fb-876cfa4bc859]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f33a58-549b-4aaa-83ba-d03be8fd699b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:05 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:03:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad904036-5d1e-4a1b-beb4-ae939d86e444]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:03:05 user nova-compute[75734]: DEBUG os_brick.utils [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Starting finish_revert_migration {{(pid=75734) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Start _get_guest_xml network_info=[{"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '274f7642-9454-4da4-b7fd-0792ff9477d7', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5dbde2ab-53f7-46db-a454-bcc8980833dc', 'attached_at': '2023-11-22T16:03:15.000000', 'detached_at': '', 'volume_id': '0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'serial': '0a8acc4b-79f1-4119-a687-3c95bdd79e6d'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:03:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:15 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:15 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:15 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3643d3f-c6ce-42ed-876f-1beb0cd1bd4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:03:15 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84be349-bd3f-4a2d-9ed0-366451d6c6b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d] added
Nov 22 16:03:15 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c0b15-7127-4fc2-a1bb-3a14815eec77]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[78833073-6fba-4f0d-94b6-4bb7f31f6a69]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxfresZS {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxfresZS" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdda29aa-cde9-4222-adf2-e7d05a03c29f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxfresZS'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b331e6-3076-4d14-a6e2-81b1b6d28ed2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd6bb8-e586-465c-a067-93a6b21d4bfc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:15 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:15 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31af69d6-9410-49ef-9cc7-2ca968ed91c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]
Nov 22 16:03:15 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.
Nov 22 16:03:15 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4398d-fb60-4820-acb2-ac19f105c362]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[902e2357-be6c-46fb-b36f-84f6808372d0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:15 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:15 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:15 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc55f9a-040d-46bf-991c-c5247442c339]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:03:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing instance network info cache due to event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] Acquiring lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] Acquired lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'flavor' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:16 user nova-compute[75734]: INFO nova.compute.manager [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Attaching volume 61c30cb0-2151-46fe-9692-786d84ba14d7 to /dev/vdb
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updated VIF entry in instance network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a6fc381f-cfa3-4892-b085-7efd552b7054 req-52bc3876-e407-4e9c-ad27-2d9543209459 service nova] Releasing lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23431633464656639', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431633464656639', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[36841c9f-34a0-4361-ab15-d9753d8118c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fac75d-a583-4cbd-8af8-70221bfbc224]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:03:16 user nova-compute[75734]:   <uuid>5dbde2ab-53f7-46db-a454-bcc8980833dc</uuid>
Nov 22 16:03:16 user nova-compute[75734]:   <name>instance-0000000d</name>
Nov 22 16:03:16 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:03:16 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:03:16 user nova-compute[75734]:   <metadata>
Nov 22 16:03:16 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:03:16 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:03:16 user nova-compute[75734]:       <nova:name>tempest-ServerActionsTestOtherB-server-707148199</nova:name>
Nov 22 16:03:16 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:03:15</nova:creationTime>
Nov 22 16:03:16 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:03:16 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:03:16 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:03:16 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:03:16 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:03:16 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:03:16 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:03:16 user nova-compute[75734]:       <nova:owner>
Nov 22 16:03:16 user nova-compute[75734]:         <nova:user uuid="4b585828df0c4d2786a02ff5621a0732">tempest-ServerActionsTestOtherB-1674044799-project-member</nova:user>
Nov 22 16:03:16 user nova-compute[75734]:         <nova:project uuid="5d179eb8ada444378bb4412630b6e12a">tempest-ServerActionsTestOtherB-1674044799</nova:project>
Nov 22 16:03:16 user nova-compute[75734]:       </nova:owner>
Nov 22 16:03:16 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:03:16 user nova-compute[75734]:       <nova:ports>
Nov 22 16:03:16 user nova-compute[75734]:         <nova:port uuid="15e6a34b-4d97-4ae0-849e-8f64c4043ddd">
Nov 22 16:03:16 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 16:03:16 user nova-compute[75734]:         </nova:port>
Nov 22 16:03:16 user nova-compute[75734]:       </nova:ports>
Nov 22 16:03:16 user nova-compute[75734]:     </nova:instance>
Nov 22 16:03:16 user nova-compute[75734]:   </metadata>
Nov 22 16:03:16 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:03:16 user nova-compute[75734]:     <system>
Nov 22 16:03:16 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:03:16 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:03:16 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:03:16 user nova-compute[75734]:       <entry name="serial">5dbde2ab-53f7-46db-a454-bcc8980833dc</entry>
Nov 22 16:03:16 user nova-compute[75734]:       <entry name="uuid">5dbde2ab-53f7-46db-a454-bcc8980833dc</entry>
Nov 22 16:03:16 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:03:16 user nova-compute[75734]:     </system>
Nov 22 16:03:16 user nova-compute[75734]:   </sysinfo>
Nov 22 16:03:16 user nova-compute[75734]:   <os>
Nov 22 16:03:16 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:03:16 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:03:16 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:03:16 user nova-compute[75734]:   </os>
Nov 22 16:03:16 user nova-compute[75734]:   <features>
Nov 22 16:03:16 user nova-compute[75734]:     <acpi/>
Nov 22 16:03:16 user nova-compute[75734]:     <apic/>
Nov 22 16:03:16 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:03:16 user nova-compute[75734]:   </features>
Nov 22 16:03:16 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:03:16 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:03:16 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:03:16 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:03:16 user nova-compute[75734]:   </clock>
Nov 22 16:03:16 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:03:16 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:03:16 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:03:16 user nova-compute[75734]:   </cpu>
Nov 22 16:03:16 user nova-compute[75734]:   <devices>
Nov 22 16:03:16 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:03:16 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:03:16 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk"/>
Nov 22 16:03:16 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:03:16 user nova-compute[75734]:     </disk>
Nov 22 16:03:16 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:03:16 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:03:16 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:03:16 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:03:16 user nova-compute[75734]:       <serial>0a8acc4b-79f1-4119-a687-3c95bdd79e6d</serial>
Nov 22 16:03:16 user nova-compute[75734]:     </disk>
Nov 22 16:03:16 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:03:16 user nova-compute[75734]:       <mac address="fa:16:3e:26:22:8a"/>
Nov 22 16:03:16 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:03:16 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:03:16 user nova-compute[75734]:       <target dev="tap15e6a34b-4d"/>
Nov 22 16:03:16 user nova-compute[75734]:     </interface>
Nov 22 16:03:16 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:03:16 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/console.log" append="off"/>
Nov 22 16:03:16 user nova-compute[75734]:     </serial>
Nov 22 16:03:16 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:03:16 user nova-compute[75734]:     <video>
Nov 22 16:03:16 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:03:16 user nova-compute[75734]:     </video>
Nov 22 16:03:16 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:03:16 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:03:16 user nova-compute[75734]:     </rng>
Nov 22 16:03:16 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:03:16 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:03:16 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:03:16 user nova-compute[75734]:     </memballoon>
Nov 22 16:03:16 user nova-compute[75734]:   </devices>
Nov 22 16:03:16 user nova-compute[75734]: </domain>
Nov 22 16:03:16 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_vif [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35847c6-285e-42f3-ac78-dfdc3b064374]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbc2679d-5524-5c99-91e9-8e5ce0b5058a', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9a54b1-852c-409e-acb4-7bc3a387889f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e6a34b-4d, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15e6a34b-4d, col_values=(('qos', UUID('7d4d5f51-2755-4554-bf97-f934a51734cc')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15e6a34b-4d, col_values=(('external_ids', {'iface-id': '15e6a34b-4d97-4ae0-849e-8f64c4043ddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:22:8a', 'vm-uuid': '5dbde2ab-53f7-46db-a454-bcc8980833dc'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:16 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:03:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[71efdd71-e4d9-422e-8a84-c06834501248]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating existing volume attachment record: 399ac952-a973-4c75-8ded-61e427ea8a23 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:03:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:16 user nova-compute[75734]: INFO os_vif [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d')
Nov 22 16:03:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-c35cdfc2-c288-4a5d-af1f-64a4c6f3b2d2 req-563b7a35-bff0-43c3-b0e6-03a8f9b262d7 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c35cdfc2-c288-4a5d-af1f-64a4c6f3b2d2 req-563b7a35-bff0-43c3-b0e6-03a8f9b262d7 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c35cdfc2-c288-4a5d-af1f-64a4c6f3b2d2 req-563b7a35-bff0-43c3-b0e6-03a8f9b262d7 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c35cdfc2-c288-4a5d-af1f-64a4c6f3b2d2 req-563b7a35-bff0-43c3-b0e6-03a8f9b262d7 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-c35cdfc2-c288-4a5d-af1f-64a4c6f3b2d2 req-563b7a35-bff0-43c3-b0e6-03a8f9b262d7 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:18 user nova-compute[75734]: WARNING nova.compute.manager [req-c35cdfc2-c288-4a5d-af1f-64a4c6f3b2d2 req-563b7a35-bff0-43c3-b0e6-03a8f9b262d7 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state resized and task_state resize_reverting.
Nov 22 16:03:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:03:20 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance running successfully.
Nov 22 16:03:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] finish_revert_migration finished successfully. {{(pid=75734) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 22 16:03:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-849c503c-a52e-4c22-b4d8-0c2ac4a0cc93 req-9595fd0c-4e14-4e8a-b0a6-f5eef325bb36 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-849c503c-a52e-4c22-b4d8-0c2ac4a0cc93 req-9595fd0c-4e14-4e8a-b0a6-f5eef325bb36 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-849c503c-a52e-4c22-b4d8-0c2ac4a0cc93 req-9595fd0c-4e14-4e8a-b0a6-f5eef325bb36 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-849c503c-a52e-4c22-b4d8-0c2ac4a0cc93 req-9595fd0c-4e14-4e8a-b0a6-f5eef325bb36 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-849c503c-a52e-4c22-b4d8-0c2ac4a0cc93 req-9595fd0c-4e14-4e8a-b0a6-f5eef325bb36 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:20 user nova-compute[75734]: WARNING nova.compute.manager [req-849c503c-a52e-4c22-b4d8-0c2ac4a0cc93 req-9595fd0c-4e14-4e8a-b0a6-f5eef325bb36 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state resized and task_state resize_reverting.
Nov 22 16:03:20 user nova-compute[75734]: INFO nova.compute.manager [None req-c9532356-1737-4c7c-9664-2c35568fa91e tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance to original state: 'active'
Nov 22 16:03:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:23 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lazy-loading 'flavor' on Instance uuid 423a0127-0a4d-4a90-af6b-777bbd7080d9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:23 user nova-compute[75734]: INFO nova.compute.manager [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Attaching volume 66d0d28f-c926-485c-9506-949ba792ec5e to /dev/vdb
Nov 22 16:03:24 user nova-compute[75734]: DEBUG os_brick.utils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca04914a-bf71-41cd-940d-ebee26f145e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c0b8b-ae70-41bf-92fb-ff0db8901b71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[093efcd2-1148-4dbd-b959-9cc7f5d22f70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31927cc4-1258-4ee5-af60-d26c662b4b78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:24 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:03:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5c933a-b4ab-4a7f-aeb4-571d6d94df5f]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG os_brick.utils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:24 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Updating existing volume attachment record: 39aa354d-4682-48cb-aab0-72ef26c4bf91 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:03:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:03:28 user nova-compute[75734]: INFO nova.compute.manager [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] instance snapshotting
Nov 22 16:03:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Beginning live snapshot process
Nov 22 16:03:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json -f qcow2 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.272s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl04y1k_v/6c9d4a2c8914457484b043358923a4d0.delta 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl04y1k_v/6c9d4a2c8914457484b043358923a4d0.delta 1073741824" returned: 0 in 0.054s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 16:03:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 16:03:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75734) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 16:03:30 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 16:03:30 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:03:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl04y1k_v/6c9d4a2c8914457484b043358923a4d0.delta /opt/stack/data/nova/instances/snapshots/tmpl04y1k_v/6c9d4a2c8914457484b043358923a4d0 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl04y1k_v/6c9d4a2c8914457484b043358923a4d0.delta /opt/stack/data/nova/instances/snapshots/tmpl04y1k_v/6c9d4a2c8914457484b043358923a4d0" returned: 0 in 0.576s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Snapshot extracted, beginning image upload
Nov 22 16:03:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxaCyAGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:33 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee36a3d5-d049-4003-afc4-a75ba77a74e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:03:33 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12f4b2-5a10-4e79-9a22-d5464453c1bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7] added
Nov 22 16:03:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQKtdVzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e2227-be0c-4e3b-a67d-c2539c5dcafa]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2fb5d4-6d88-4ba2-bdd7-fc4454aa7ee3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxaCyAGb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxaCyAGb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e2148-b72e-428b-978b-7c8f8d591199]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HxaCyAGb'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[756bc833-0cc3-41a1-9bef-50b72bd0e951]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b75ba0-6273-4fe4-ac03-da0ae6bcbdcb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ce44a1-b3ba-4894-98b9-1232b082c382]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260]
Nov 22 16:03:33 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260] successful.
Nov 22 16:03:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d503750d-b405-49fc-a189-8a8158469e22]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f08d01-858f-461a-abc3-f03fea679e05]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:33 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb18d474-ecdd-47a1-9d23-04b8f69134b9]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:03:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Snapshot image upload complete
Nov 22 16:03:34 user nova-compute[75734]: INFO nova.compute.manager [None req-536ec5ba-7459-4ffd-8e88-35ea0d309738 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Took 5.94 seconds to snapshot the instance on the hypervisor.
Nov 22 16:03:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxaCyAGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23330353961323065', 'path': '/dev/sdf'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330353961323065', 'path': '/dev/sdf'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.362s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:34 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:34 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'flavor' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7279fb72-7439-4bec-9f15-97f2013f62c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:03:34 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:03:34 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:03:34 user nova-compute[75734]:   <source dev="/dev/sdf"/>
Nov 22 16:03:34 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:03:34 user nova-compute[75734]:   <serial>61c30cb0-2151-46fe-9692-786d84ba14d7</serial>
Nov 22 16:03:34 user nova-compute[75734]: </disk>
Nov 22 16:03:34 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8ed2ea-6c74-4104-9cf4-d7c78a64b8b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e] added
Nov 22 16:03:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe7a9f-a157-4cdc-a688-c62f7d19afb3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c4fa9-ab65-4e41-a979-902e569cf4a4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQKtdVzo {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQKtdVzo" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c148e-70da-4464-a7a0-bf4f91d689d6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQKtdVzo'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[247b48bb-bba6-4dbf-ab12-82e999d63c82]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb6dee-f15e-433a-8b75-aafb99510b33]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22074fb-830d-4e92-857b-2cbd0df38de5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260]
Nov 22 16:03:34 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260] successful.
Nov 22 16:03:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f78514-6d0f-475f-8a26-712f124df99a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dc9e24-ffd0-417f-87b9-3b54f7eeabe6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e (non-flash)
Nov 22 16:03:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:34 user nova-compute[75734]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e (non-flash)
Nov 22 16:03:34 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f773e0f8-640f-49f0-8764-e31c62d4b98f]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:03:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQKtdVzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No VIF found with MAC fa:16:3e:97:23:9f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f88d96b7-f986-4446-ad87-077f6aea761e tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.765s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] <== connect_volume: return (2739ms) {'type': 'block', 'scsi_wwn': '23232373062376663', 'path': '/dev/sdg'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232373062376663', 'path': '/dev/sdg'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lazy-loading 'flavor' on Instance uuid 423a0127-0a4d-4a90-af6b-777bbd7080d9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:03:35 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:03:35 user nova-compute[75734]:   <source dev="/dev/sdg"/>
Nov 22 16:03:35 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:03:35 user nova-compute[75734]:   <serial>66d0d28f-c926-485c-9506-949ba792ec5e</serial>
Nov 22 16:03:35 user nova-compute[75734]: </disk>
Nov 22 16:03:35 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:36 user nova-compute[75734]: INFO nova.compute.manager [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Rescuing
Nov 22 16:03:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] No VIF found with MAC fa:16:3e:a1:a0:d0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0fb9ebc7-60c3-48c1-a024-231693920ef8 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.564s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-66316801-0fcc-487d-afaf-5fccecab1508 req-4f4d0e84-e9ce-40f4-98c0-ea1e993e2c0f service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66316801-0fcc-487d-afaf-5fccecab1508 req-4f4d0e84-e9ce-40f4-98c0-ea1e993e2c0f service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66316801-0fcc-487d-afaf-5fccecab1508 req-4f4d0e84-e9ce-40f4-98c0-ea1e993e2c0f service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66316801-0fcc-487d-afaf-5fccecab1508 req-4f4d0e84-e9ce-40f4-98c0-ea1e993e2c0f service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-66316801-0fcc-487d-afaf-5fccecab1508 req-4f4d0e84-e9ce-40f4-98c0-ea1e993e2c0f service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:37 user nova-compute[75734]: WARNING nova.compute.manager [req-66316801-0fcc-487d-afaf-5fccecab1508 req-4f4d0e84-e9ce-40f4-98c0-ea1e993e2c0f service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state active and task_state rescuing.
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:37 user nova-compute[75734]: INFO nova.compute.manager [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Terminating instance
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance destroyed successfully.
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Attempting rescue
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75734) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 16:03:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Creating image(s)
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d7e427c-115b-4bc1-99f5-f8d9c53820be req-cd67f00a-9eed-4233-b0e0-9936ad9c4cd4 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received event network-vif-unplugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d7e427c-115b-4bc1-99f5-f8d9c53820be req-cd67f00a-9eed-4233-b0e0-9936ad9c4cd4 service nova] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d7e427c-115b-4bc1-99f5-f8d9c53820be req-cd67f00a-9eed-4233-b0e0-9936ad9c4cd4 service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d7e427c-115b-4bc1-99f5-f8d9c53820be req-cd67f00a-9eed-4233-b0e0-9936ad9c4cd4 service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d7e427c-115b-4bc1-99f5-f8d9c53820be req-cd67f00a-9eed-4233-b0e0-9936ad9c4cd4 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] No waiting events found dispatching network-vif-unplugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d7e427c-115b-4bc1-99f5-f8d9c53820be req-cd67f00a-9eed-4233-b0e0-9936ad9c4cd4 service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received event network-vif-unplugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue" returned: 0 in 0.052s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'migration_context' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.base [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Start _get_guest_xml network_info=[{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:97:23:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'resources' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.base [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'numa_topology' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.base [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:03:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.base [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1052250505',display_name='tempest-ServerRescueNegativeTestJSON-server-1052250505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1052250505',id=19,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV+1ijUPIxlObi7Otae2ssSP0pilyTlOPtuJzQIeQzKupfZ+pUbwSRpE2UOpK5LFKQ8PTYGl1ziklby0PniLrCSyXVOTJ2L3HudeI/U9Ag02k4cBlmGTYLHNrflOILtfQ==',key_name='tempest-keypair-124342039',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-vwg1bjqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea603e7c80014f17a76fec19b54443c9',uuid=15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:97:23:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "vif_mac": "fa:16:3e:97:23:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'pci_devices' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.base [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Object Instance<15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:03:38 user nova-compute[75734]:   <uuid>15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c</uuid>
Nov 22 16:03:38 user nova-compute[75734]:   <name>instance-00000013</name>
Nov 22 16:03:38 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:03:38 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:03:38 user nova-compute[75734]:   <metadata>
Nov 22 16:03:38 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:03:38 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:03:38 user nova-compute[75734]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1052250505</nova:name>
Nov 22 16:03:38 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:03:38</nova:creationTime>
Nov 22 16:03:38 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:03:38 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:03:38 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:03:38 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:03:38 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:03:38 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:03:38 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:03:38 user nova-compute[75734]:       <nova:owner>
Nov 22 16:03:38 user nova-compute[75734]:         <nova:user uuid="ea603e7c80014f17a76fec19b54443c9">tempest-ServerRescueNegativeTestJSON-970419785-project-member</nova:user>
Nov 22 16:03:38 user nova-compute[75734]:         <nova:project uuid="963ad36880484ed59f2b34c64a6e450e">tempest-ServerRescueNegativeTestJSON-970419785</nova:project>
Nov 22 16:03:38 user nova-compute[75734]:       </nova:owner>
Nov 22 16:03:38 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:03:38 user nova-compute[75734]:       <nova:ports>
Nov 22 16:03:38 user nova-compute[75734]:         <nova:port uuid="05b840f9-4c08-477c-99c5-72dcd541d8e6">
Nov 22 16:03:38 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 16:03:38 user nova-compute[75734]:         </nova:port>
Nov 22 16:03:38 user nova-compute[75734]:       </nova:ports>
Nov 22 16:03:38 user nova-compute[75734]:     </nova:instance>
Nov 22 16:03:38 user nova-compute[75734]:   </metadata>
Nov 22 16:03:38 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:03:38 user nova-compute[75734]:     <system>
Nov 22 16:03:38 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:03:38 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:03:38 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:03:38 user nova-compute[75734]:       <entry name="serial">15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c</entry>
Nov 22 16:03:38 user nova-compute[75734]:       <entry name="uuid">15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c</entry>
Nov 22 16:03:38 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:03:38 user nova-compute[75734]:     </system>
Nov 22 16:03:38 user nova-compute[75734]:   </sysinfo>
Nov 22 16:03:38 user nova-compute[75734]:   <os>
Nov 22 16:03:38 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:03:38 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:03:38 user nova-compute[75734]:   </os>
Nov 22 16:03:38 user nova-compute[75734]:   <features>
Nov 22 16:03:38 user nova-compute[75734]:     <acpi/>
Nov 22 16:03:38 user nova-compute[75734]:     <apic/>
Nov 22 16:03:38 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:03:38 user nova-compute[75734]:   </features>
Nov 22 16:03:38 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:03:38 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:03:38 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:03:38 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:03:38 user nova-compute[75734]:   </clock>
Nov 22 16:03:38 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:03:38 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:03:38 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:03:38 user nova-compute[75734]:   </cpu>
Nov 22 16:03:38 user nova-compute[75734]:   <devices>
Nov 22 16:03:38 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:03:38 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:03:38 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue"/>
Nov 22 16:03:38 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:03:38 user nova-compute[75734]:     </disk>
Nov 22 16:03:38 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:03:38 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:03:38 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk"/>
Nov 22 16:03:38 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:03:38 user nova-compute[75734]:     </disk>
Nov 22 16:03:38 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:03:38 user nova-compute[75734]:       <mac address="fa:16:3e:97:23:9f"/>
Nov 22 16:03:38 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:03:38 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:03:38 user nova-compute[75734]:       <target dev="tap05b840f9-4c"/>
Nov 22 16:03:38 user nova-compute[75734]:     </interface>
Nov 22 16:03:38 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:03:38 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/console.log" append="off"/>
Nov 22 16:03:38 user nova-compute[75734]:     </serial>
Nov 22 16:03:38 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:03:38 user nova-compute[75734]:     <video>
Nov 22 16:03:38 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:03:38 user nova-compute[75734]:     </video>
Nov 22 16:03:38 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:03:38 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:03:38 user nova-compute[75734]:     </rng>
Nov 22 16:03:38 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:03:38 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:03:38 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:03:38 user nova-compute[75734]:     </memballoon>
Nov 22 16:03:38 user nova-compute[75734]:   </devices>
Nov 22 16:03:38 user nova-compute[75734]: </domain>
Nov 22 16:03:38 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:03:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance destroyed successfully.
Nov 22 16:03:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Instance destroyed successfully.
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lazy-loading 'resources' on Instance uuid 423a0127-0a4d-4a90-af6b-777bbd7080d9 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-625653779',display_name='tempest-DeleteServersTestJSON-server-625653779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-625653779',id=20,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6771bb37f7bf493e9790d4f35ddba288',ramdisk_id='',reservation_id='r-3ttep5jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-819563755',owner_user_name='tempest-DeleteServersTestJSON-819563755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:01:38Z,user_data=None,user_id='034e5954946d4b65a60c328edbfffeb5',uuid=423a0127-0a4d-4a90-af6b-777bbd7080d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Converting VIF {"id": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "address": "fa:16:3e:a1:a0:d0", "network": {"id": "6eff52f9-33b9-4590-a2ba-c555ba578a42", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1761856746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6771bb37f7bf493e9790d4f35ddba288", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7f01d0-1f", "ovs_interfaceid": "7c7f01d0-1f91-4007-9f7c-c3c80d158f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=7c7f01d0-1f91-4007-9f7c-c3c80d158f1e,network=Network(6eff52f9-33b9-4590-a2ba-c555ba578a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7f01d0-1f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_vif [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=7c7f01d0-1f91-4007-9f7c-c3c80d158f1e,network=Network(6eff52f9-33b9-4590-a2ba-c555ba578a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7f01d0-1f') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c7f01d0-1f, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=416d48ec-3fa7-4167-909a-e62ffd40e56c) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:38 user nova-compute[75734]: INFO os_vif [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=7c7f01d0-1f91-4007-9f7c-c3c80d158f1e,network=Network(6eff52f9-33b9-4590-a2ba-c555ba578a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7f01d0-1f')
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQKtdVzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:38 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] No VIF found with MAC fa:16:3e:97:23:9f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05043a9-e219-4c1b-a931-d408ac146243]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:03:38 user nova-compute[75734]: No targets found.
Nov 22 16:03:38 user nova-compute[75734]: iSNS:
Nov 22 16:03:38 user nova-compute[75734]: No targets found.
Nov 22 16:03:38 user nova-compute[75734]: STATIC:
Nov 22 16:03:38 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:03:38 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:38 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:38 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:03:38 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:38 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:38 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa
Nov 22 16:03:38 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:38 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:38 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e
Nov 22 16:03:38 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:38 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:38 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b
Nov 22 16:03:38 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:38 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:38 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:03:38 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:38 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:38 user nova-compute[75734]: FIRMWARE:
Nov 22 16:03:38 user nova-compute[75734]: No targets found.
Nov 22 16:03:38 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:03:38 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:03:38 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[539660aa-a45e-4d31-8b07-bf672b767f74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3bbf7d-a626-4a4e-bd50-e8bca9a3b0d3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e (non-flash)
Nov 22 16:03:38 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:38 user nova-compute[75734]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e (non-flash)
Nov 22 16:03:38 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc522ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e'): ({'sdg'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Removing single pathed devices sdg {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e37df50-3142-48f1-b850-75d81119b412]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cac262-4670-42f0-b21f-bada911cbe13]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Flushing IO for device /dev/sdg {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aca673-2fea-4a17-9e2b-1fe31d24a675]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[391bb9f7-9b01-4b33-a255-7719d5901a50]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a600b-3fbf-4783-a185-74ee7887262d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd946a73-fc0f-4937-a273-df4e7fa3ba40]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260]
Nov 22 16:03:38 user nova-compute[75734]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e, portal: 172.16.0.220,3260] successful.
Nov 22 16:03:38 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0d28f-c926-485c-9506-949ba792ec5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9102e48-5edf-4668-a562-3427e3bf340f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] <== disconnect_volume: return (326ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:03:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Deleting instance files /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9_del
Nov 22 16:03:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Deletion of /opt/stack/data/nova/instances/423a0127-0a4d-4a90-af6b-777bbd7080d9_del complete
Nov 22 16:03:38 user nova-compute[75734]: INFO nova.compute.manager [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 22 16:03:38 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:03:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e5e6907-9d38-482e-91d6-00422bc9c7ea req-c4682923-7d41-4c66-8c34-e377320d7425 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e5e6907-9d38-482e-91d6-00422bc9c7ea req-c4682923-7d41-4c66-8c34-e377320d7425 service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e5e6907-9d38-482e-91d6-00422bc9c7ea req-c4682923-7d41-4c66-8c34-e377320d7425 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e5e6907-9d38-482e-91d6-00422bc9c7ea req-c4682923-7d41-4c66-8c34-e377320d7425 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e5e6907-9d38-482e-91d6-00422bc9c7ea req-c4682923-7d41-4c66-8c34-e377320d7425 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:39 user nova-compute[75734]: WARNING nova.compute.manager [req-2e5e6907-9d38-482e-91d6-00422bc9c7ea req-c4682923-7d41-4c66-8c34-e377320d7425 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state active and task_state rescuing.
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:39 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Took 0.70 seconds to deallocate network for instance.
Nov 22 16:03:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received event network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] Acquiring lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] No waiting events found dispatching network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:39 user nova-compute[75734]: WARNING nova.compute.manager [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received unexpected event network-vif-plugged-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e for instance with vm_state active and task_state deleting.
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-changed-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Refreshing instance network info cache due to event network-changed-8096492b-5d84-445a-8b97-d5bcbabef66c. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] Acquiring lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] Acquired lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Refreshing network info cache for port 8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'flavor' on Instance uuid 452d0048-4b11-40f4-b004-d7ded6232e54 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:40 user nova-compute[75734]: INFO nova.compute.manager [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Took 0.82 seconds to detach 1 volumes for instance.
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:40 user nova-compute[75734]: INFO nova.compute.manager [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Attaching volume e7178529-a0fe-4c6d-a6f5-ebb51c1428de to /dev/vdb
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG os_brick.utils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4ff233-c043-47cd-885b-0c93ae1e4cbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664515f-d89d-46fc-968c-7279c6bec781]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beedc2f-35af-4131-bbe3-d050d326371f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[135dabea-8a70-42ab-a85a-3f994ca809fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:40 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea228e1a-4a3b-479b-8ff5-38cf3e783de9]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG os_brick.utils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updating existing volume attachment record: 74698f90-d3e3-4317-b05f-5e7102db1bfe {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:40 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Deleted allocations for instance 423a0127-0a4d-4a90-af6b-777bbd7080d9
Nov 22 16:03:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fd0f2528-3917-4f5a-b91b-4645af353560 tempest-DeleteServersTestJSON-819563755 tempest-DeleteServersTestJSON-819563755-project-member] Lock "423a0127-0a4d-4a90-af6b-777bbd7080d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.network.neutron [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updated VIF entry in instance network info cache for port 8096492b-5d84-445a-8b97-d5bcbabef66c. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.network.neutron [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updating instance_info_cache with network_info: [{"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84a04548-e6ad-49f7-9093-802a681182c1 req-7abe24a2-8178-485d-b033-0d00bc33cb7c service nova] Releasing lock "refresh_cache-452d0048-4b11-40f4-b004-d7ded6232e54" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] [instance: 423a0127-0a4d-4a90-af6b-777bbd7080d9] Received event network-vif-deleted-7c7f01d0-1f91-4007-9f7c-c3c80d158f1e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:41 user nova-compute[75734]: WARNING nova.compute.manager [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state active and task_state rescuing.
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:41 user nova-compute[75734]: WARNING nova.compute.manager [req-13026550-99fd-4efc-959d-f0e2eb7890b2 req-a7423c6d-1f16-4863-8a23-ee80da2687ad service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state active and task_state rescuing.
Nov 22 16:03:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-997a831e-709b-41b5-abeb-088080f2a616 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:03:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:03:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:03:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:46 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:03:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:03:47 user nova-compute[75734]: INFO nova.compute.claims [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Claim successful on node user
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:47 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:47 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:47 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ab565d-4578-4ecf-829c-959c3e21f4a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:03:47 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce8aade-aa15-4850-abf2-dd553c0c5d3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de] added
Nov 22 16:03:47 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c7bfe-67b9-4d5e-9669-be91346a2167]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f0419-9ee6-4b23-987a-8071c3508a57]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrlUGQcY {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrlUGQcY" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73b0245-a95f-4d52-9a14-7d038185b453]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mrlUGQcY'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fdc069-306e-4170-922f-16e831ce5383]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[189b0e29-8885-409e-845a-9a5dfdbe021b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:47 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:47 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:47 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:03:47 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.policy [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd50ff8d823484b29a664d2a0d19f6fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa94e0f8306e45668c29e5a296222069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:03:47 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Creating image(s)
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "/opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "/opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "/opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.233s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.238s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk 1073741824" returned: 0 in 0.080s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Successfully created port: 4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --login" returned: 0 in 1.081s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8367a5-cb26-4c54-8648-dec65db44b76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]
Nov 22 16:03:48 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.
Nov 22 16:03:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a607b5f1-439c-4391-9a3c-63a63fe17531]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca64d2d-41fe-4c38-8c0e-f89c8cc06977]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:03:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:48 user nova-compute[75734]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:03:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.311s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2849ad67-7ee6-4f4d-ae8f-17a63ae6dcd2]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Cannot resize image /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Ensure instance console log exists: /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Successfully updated port: 4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquired lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:03:48 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-changed-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Refreshing instance network info cache due to event network-changed-4d1268d1-c615-41a0-9db7-7eec1b68a27d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] Acquiring lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating instance_info_cache with network_info: [{"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Releasing lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Instance network_info: |[{"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] Acquired lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.neutron [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Refreshing network info cache for port 4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Start _get_guest_xml network_info=[{"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:03:49 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:49 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1762983324',display_name='tempest-SnapshotDataIntegrityTests-server-1762983324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1762983324',id=24,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZGmfwPjB/VXRFm34XgEFEsw/gBJONz9y0lFKVZk2c2/Ypgnl3L3zYeGyzBR6+AglzW+4MDtpO/FVYhGEVLiZwWgQtZTam6919CLnxFwv+fwPBxQn4MuGWCNJMdOcPMjg==',key_name='tempest-keypair-874668113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa94e0f8306e45668c29e5a296222069',ramdisk_id='',reservation_id='r-988tmhyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-388543575',owner_user_name='tempest-SnapshotDataIntegrityTests-388543575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50ff8d823484b29a664d2a0d19f6fc0',uuid=90daf829-e4b2-4f46-a915-d2374bb0896c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Converting VIF {"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:13:28,bridge_name='br-int',has_traffic_filtering=True,id=4d1268d1-c615-41a0-9db7-7eec1b68a27d,network=Network(bd40a1f6-a581-41b1-9db5-234894296ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1268d1-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.objects.instance [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'pci_devices' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:03:49 user nova-compute[75734]:   <uuid>90daf829-e4b2-4f46-a915-d2374bb0896c</uuid>
Nov 22 16:03:49 user nova-compute[75734]:   <name>instance-00000018</name>
Nov 22 16:03:49 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:03:49 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:03:49 user nova-compute[75734]:   <metadata>
Nov 22 16:03:49 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:03:49 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:03:49 user nova-compute[75734]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1762983324</nova:name>
Nov 22 16:03:49 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:03:49</nova:creationTime>
Nov 22 16:03:49 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:03:49 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:03:49 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:03:49 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:03:49 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:03:49 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:03:49 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:03:49 user nova-compute[75734]:       <nova:owner>
Nov 22 16:03:49 user nova-compute[75734]:         <nova:user uuid="d50ff8d823484b29a664d2a0d19f6fc0">tempest-SnapshotDataIntegrityTests-388543575-project-member</nova:user>
Nov 22 16:03:49 user nova-compute[75734]:         <nova:project uuid="aa94e0f8306e45668c29e5a296222069">tempest-SnapshotDataIntegrityTests-388543575</nova:project>
Nov 22 16:03:49 user nova-compute[75734]:       </nova:owner>
Nov 22 16:03:49 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:03:49 user nova-compute[75734]:       <nova:ports>
Nov 22 16:03:49 user nova-compute[75734]:         <nova:port uuid="4d1268d1-c615-41a0-9db7-7eec1b68a27d">
Nov 22 16:03:49 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 16:03:49 user nova-compute[75734]:         </nova:port>
Nov 22 16:03:49 user nova-compute[75734]:       </nova:ports>
Nov 22 16:03:49 user nova-compute[75734]:     </nova:instance>
Nov 22 16:03:49 user nova-compute[75734]:   </metadata>
Nov 22 16:03:49 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:03:49 user nova-compute[75734]:     <system>
Nov 22 16:03:49 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:03:49 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:03:49 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:03:49 user nova-compute[75734]:       <entry name="serial">90daf829-e4b2-4f46-a915-d2374bb0896c</entry>
Nov 22 16:03:49 user nova-compute[75734]:       <entry name="uuid">90daf829-e4b2-4f46-a915-d2374bb0896c</entry>
Nov 22 16:03:49 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:03:49 user nova-compute[75734]:     </system>
Nov 22 16:03:49 user nova-compute[75734]:   </sysinfo>
Nov 22 16:03:49 user nova-compute[75734]:   <os>
Nov 22 16:03:49 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:03:49 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:03:49 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:03:49 user nova-compute[75734]:   </os>
Nov 22 16:03:49 user nova-compute[75734]:   <features>
Nov 22 16:03:49 user nova-compute[75734]:     <acpi/>
Nov 22 16:03:49 user nova-compute[75734]:     <apic/>
Nov 22 16:03:49 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:03:49 user nova-compute[75734]:   </features>
Nov 22 16:03:49 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:03:49 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:03:49 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:03:49 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:03:49 user nova-compute[75734]:   </clock>
Nov 22 16:03:49 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:03:49 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:03:49 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:03:49 user nova-compute[75734]:   </cpu>
Nov 22 16:03:49 user nova-compute[75734]:   <devices>
Nov 22 16:03:49 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:03:49 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:03:49 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk"/>
Nov 22 16:03:49 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:03:49 user nova-compute[75734]:     </disk>
Nov 22 16:03:49 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:03:49 user nova-compute[75734]:       <mac address="fa:16:3e:de:13:28"/>
Nov 22 16:03:49 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:03:49 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:03:49 user nova-compute[75734]:       <target dev="tap4d1268d1-c6"/>
Nov 22 16:03:49 user nova-compute[75734]:     </interface>
Nov 22 16:03:49 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:03:49 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/console.log" append="off"/>
Nov 22 16:03:49 user nova-compute[75734]:     </serial>
Nov 22 16:03:49 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:03:49 user nova-compute[75734]:     <video>
Nov 22 16:03:49 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:03:49 user nova-compute[75734]:     </video>
Nov 22 16:03:49 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:03:49 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:03:49 user nova-compute[75734]:     </rng>
Nov 22 16:03:49 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:03:49 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:03:49 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:03:49 user nova-compute[75734]:     </memballoon>
Nov 22 16:03:49 user nova-compute[75734]:   </devices>
Nov 22 16:03:49 user nova-compute[75734]: </domain>
Nov 22 16:03:49 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1762983324',display_name='tempest-SnapshotDataIntegrityTests-server-1762983324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1762983324',id=24,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZGmfwPjB/VXRFm34XgEFEsw/gBJONz9y0lFKVZk2c2/Ypgnl3L3zYeGyzBR6+AglzW+4MDtpO/FVYhGEVLiZwWgQtZTam6919CLnxFwv+fwPBxQn4MuGWCNJMdOcPMjg==',key_name='tempest-keypair-874668113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa94e0f8306e45668c29e5a296222069',ramdisk_id='',reservation_id='r-988tmhyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-388543575',owner_user_name='tempest-SnapshotDataIntegrityTests-388543575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50ff8d823484b29a664d2a0d19f6fc0',uuid=90daf829-e4b2-4f46-a915-d2374bb0896c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Converting VIF {"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:13:28,bridge_name='br-int',has_traffic_filtering=True,id=4d1268d1-c615-41a0-9db7-7eec1b68a27d,network=Network(bd40a1f6-a581-41b1-9db5-234894296ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1268d1-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG os_vif [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:13:28,bridge_name='br-int',has_traffic_filtering=True,id=4d1268d1-c615-41a0-9db7-7eec1b68a27d,network=Network(bd40a1f6-a581-41b1-9db5-234894296ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1268d1-c6') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0805b5ca-aa64-5d6e-8113-74dd4b29e5af', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d1268d1-c6, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d1268d1-c6, col_values=(('qos', UUID('f4b63868-9f17-4d61-8081-52f592c1bf27')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d1268d1-c6, col_values=(('external_ids', {'iface-id': '4d1268d1-c615-41a0-9db7-7eec1b68a27d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:13:28', 'vm-uuid': '90daf829-e4b2-4f46-a915-d2374bb0896c'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:49 user nova-compute[75734]: INFO os_vif [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:13:28,bridge_name='br-int',has_traffic_filtering=True,id=4d1268d1-c615-41a0-9db7-7eec1b68a27d,network=Network(bd40a1f6-a581-41b1-9db5-234894296ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1268d1-c6')
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No VIF found with MAC fa:16:3e:de:13:28, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.353s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== connect_volume: return (2355ms) {'type': 'block', 'scsi_wwn': '23233376131666533', 'path': '/dev/sdg'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233376131666533', 'path': '/dev/sdg'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'flavor' on Instance uuid 452d0048-4b11-40f4-b004-d7ded6232e54 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:03:49 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:03:49 user nova-compute[75734]:   <source dev="/dev/sdg"/>
Nov 22 16:03:49 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:03:49 user nova-compute[75734]:   <serial>e7178529-a0fe-4c6d-a6f5-ebb51c1428de</serial>
Nov 22 16:03:49 user nova-compute[75734]: </disk>
Nov 22 16:03:49 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.neutron [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updated VIF entry in instance network info cache for port 4d1268d1-c615-41a0-9db7-7eec1b68a27d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG nova.network.neutron [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating instance_info_cache with network_info: [{"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:03:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b587fdaa-b79a-4b86-998b-f7598ab65502 req-749ec8bb-1eab-49e5-a573-1bf98974fa1e service nova] Releasing lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No VIF found with MAC fa:16:3e:39:d8:f4, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8ab1bb2b-8bf9-471d-b33d-2407107c1669 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.164s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-8e6b2f9f-023c-40e0-9e5d-e5fb008d9059 req-4c73fed0-cb28-45f2-aae0-24fbdfe756f3 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8e6b2f9f-023c-40e0-9e5d-e5fb008d9059 req-4c73fed0-cb28-45f2-aae0-24fbdfe756f3 service nova] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8e6b2f9f-023c-40e0-9e5d-e5fb008d9059 req-4c73fed0-cb28-45f2-aae0-24fbdfe756f3 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8e6b2f9f-023c-40e0-9e5d-e5fb008d9059 req-4c73fed0-cb28-45f2-aae0-24fbdfe756f3 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-8e6b2f9f-023c-40e0-9e5d-e5fb008d9059 req-4c73fed0-cb28-45f2-aae0-24fbdfe756f3 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] No waiting events found dispatching network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:51 user nova-compute[75734]: WARNING nova.compute.manager [req-8e6b2f9f-023c-40e0-9e5d-e5fb008d9059 req-4c73fed0-cb28-45f2-aae0-24fbdfe756f3 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received unexpected event network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d for instance with vm_state building and task_state spawning.
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:03:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:51 user nova-compute[75734]: INFO nova.compute.manager [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Rebuilding instance
Nov 22 16:03:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-371cd598-30b0-403c-ad12-e92b785a10e3 req-c1a62a13-0edb-40b2-8f5e-b2ea87649da2 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-unplugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-371cd598-30b0-403c-ad12-e92b785a10e3 req-c1a62a13-0edb-40b2-8f5e-b2ea87649da2 service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-371cd598-30b0-403c-ad12-e92b785a10e3 req-c1a62a13-0edb-40b2-8f5e-b2ea87649da2 service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-371cd598-30b0-403c-ad12-e92b785a10e3 req-c1a62a13-0edb-40b2-8f5e-b2ea87649da2 service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-371cd598-30b0-403c-ad12-e92b785a10e3 req-c1a62a13-0edb-40b2-8f5e-b2ea87649da2 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-unplugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:52 user nova-compute[75734]: WARNING nova.compute.manager [req-371cd598-30b0-403c-ad12-e92b785a10e3 req-c1a62a13-0edb-40b2-8f5e-b2ea87649da2 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received unexpected event network-vif-unplugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with vm_state active and task_state rebuilding.
Nov 22 16:03:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance destroyed successfully.
Nov 22 16:03:53 user nova-compute[75734]: INFO nova.compute.manager [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Detaching volume e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: INFO nova.virt.block_device [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Attempting to driver detach volume e7178529-a0fe-4c6d-a6f5-ebb51c1428de from mountpoint /dev/vdb
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Attempting to detach device vdb from instance 452d0048-4b11-40f4-b004-d7ded6232e54 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:03:53 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:03:53 user nova-compute[75734]:   <source dev="/dev/sdg"/>
Nov 22 16:03:53 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:03:53 user nova-compute[75734]:   <serial>e7178529-a0fe-4c6d-a6f5-ebb51c1428de</serial>
Nov 22 16:03:53 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:03:53 user nova-compute[75734]: </disk>
Nov 22 16:03:53 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:03:53 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully detached device vdb from instance 452d0048-4b11-40f4-b004-d7ded6232e54 from the persistent domain config.
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:53 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd55cc9a-99c1-45b7-a986-24c6e5297535]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:03:53 user nova-compute[75734]: No targets found.
Nov 22 16:03:53 user nova-compute[75734]: iSNS:
Nov 22 16:03:53 user nova-compute[75734]: No targets found.
Nov 22 16:03:53 user nova-compute[75734]: STATIC:
Nov 22 16:03:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:03:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:03:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:03:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa
Nov 22 16:03:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b
Nov 22 16:03:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:03:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:53 user nova-compute[75734]: FIRMWARE:
Nov 22 16:03:53 user nova-compute[75734]: No targets found.
Nov 22 16:03:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:03:53 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:03:53 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4209af5-fbf1-4d1e-b85e-efec692bf606]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[938e4274-b326-40c3-b456-fc1d91605564]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:03:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:53 user nova-compute[75734]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:03:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eccfc71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de'): ({'sdg'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Removing single pathed devices sdg {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[913fd909-6870-4064-8038-4013d3a1bcc7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4b5eff-5dfd-4df2-9e7c-e184bf3f6d40]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flushing IO for device /dev/sdg {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[03118792-41ee-4ee7-b1d2-b47282adab96]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91d34e-9d4d-4df2-8663-cc6c06353922]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:03:53 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Instance spawned successfully.
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-4a4444bf-e65b-42dd-b611-09bb863d74f2 req-1ccb51e5-4d02-404c-befa-9aacb121f8c3 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4a4444bf-e65b-42dd-b611-09bb863d74f2 req-1ccb51e5-4d02-404c-befa-9aacb121f8c3 service nova] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4a4444bf-e65b-42dd-b611-09bb863d74f2 req-1ccb51e5-4d02-404c-befa-9aacb121f8c3 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4a4444bf-e65b-42dd-b611-09bb863d74f2 req-1ccb51e5-4d02-404c-befa-9aacb121f8c3 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.compute.manager [req-4a4444bf-e65b-42dd-b611-09bb863d74f2 req-1ccb51e5-4d02-404c-befa-9aacb121f8c3 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] No waiting events found dispatching network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:53 user nova-compute[75734]: WARNING nova.compute.manager [req-4a4444bf-e65b-42dd-b611-09bb863d74f2 req-1ccb51e5-4d02-404c-befa-9aacb121f8c3 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received unexpected event network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d for instance with vm_state building and task_state spawning.
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf1f57-e647-4fe9-8176-55e4cc49cb64]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f61fa-d9f7-4ba8-9b9d-dbe0b71c4f84]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]
Nov 22 16:03:53 user nova-compute[75734]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.
Nov 22 16:03:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: INFO nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67dc29a-4364-43e9-81e5-7a6f824f9eec]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== disconnect_volume: return (389ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:53 user nova-compute[75734]: INFO nova.compute.manager [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Took 6.87 seconds to build instance.
Nov 22 16:03:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bf09d9ba-66d7-4b4a-98ef-c5ead10294bd tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.992s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance destroyed successfully.
Nov 22 16:03:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-621823763',display_name='tempest-ServerActionsTestOtherA-server-642600834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-621823763',id=22,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYitI8eNfB1WQDTrUNK8TBNh++AzBu18shj48L/hxhb5AEOAgsFIsMhpBNoR4suzzbEiyjKSGcIzZd665wV8TzuxDG7wFiixXZlqj4I6VD8gFswGXXpxAkFJiROJrAq6g==',key_name='tempest-keypair-1609171650',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-6veorgxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=452d0048-4b11-40f4-b004-d7ded6232e54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_vif [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-6f23f674-3ff3-402d-b969-650d5f728998 req-431640ed-850b-490f-be66-412e0ca7e3cd service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6f23f674-3ff3-402d-b969-650d5f728998 req-431640ed-850b-490f-be66-412e0ca7e3cd service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6f23f674-3ff3-402d-b969-650d5f728998 req-431640ed-850b-490f-be66-412e0ca7e3cd service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6f23f674-3ff3-402d-b969-650d5f728998 req-431640ed-850b-490f-be66-412e0ca7e3cd service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-6f23f674-3ff3-402d-b969-650d5f728998 req-431640ed-850b-490f-be66-412e0ca7e3cd service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:03:54 user nova-compute[75734]: WARNING nova.compute.manager [req-6f23f674-3ff3-402d-b969-650d5f728998 req-431640ed-850b-490f-be66-412e0ca7e3cd service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received unexpected event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with vm_state active and task_state rebuilding.
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8096492b-5d, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3897470-08cc-4d6f-9484-f11043abea7a) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:03:54 user nova-compute[75734]: INFO os_vif [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d')
Nov 22 16:03:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:54 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6154db-6198-4801-8eb0-8b700df65b26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:03:54 user nova-compute[75734]: No targets found.
Nov 22 16:03:54 user nova-compute[75734]: iSNS:
Nov 22 16:03:54 user nova-compute[75734]: No targets found.
Nov 22 16:03:54 user nova-compute[75734]: STATIC:
Nov 22 16:03:54 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:03:54 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:54 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:54 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:03:54 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:54 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:54 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa
Nov 22 16:03:54 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:54 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:54 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b
Nov 22 16:03:54 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:54 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:54 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:03:54 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:03:54 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:03:54 user nova-compute[75734]: FIRMWARE:
Nov 22 16:03:54 user nova-compute[75734]: No targets found.
Nov 22 16:03:54 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:03:54 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:03:54 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0912c1c-9486-4aa3-bce1-834059b0cbaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc21701-5208-4eee-8821-b73772c9da4f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:54 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:03:54 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:03:54 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7bea70>, {}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Disconnecting from: [] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.146s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== disconnect_volume: return (147ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:03:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Deleting instance files /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54_del
Nov 22 16:03:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Deletion of /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54_del complete
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: INFO nova.virt.block_device [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Booting with volume e7178529-a0fe-4c6d-a6f5-ebb51c1428de at /dev/vdb
Nov 22 16:03:55 user nova-compute[75734]: DEBUG os_brick.utils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a6f941-e4f3-4964-8e12-d34d16172b1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b1d9da-1051-426c-bd32-3ab89ed5d59d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fbc367-6aa9-4933-b875-143f76a9de05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d031f4c-ffb4-4e01-8de3-884cb5f9fcf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:03:55 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ff1428-1785-4b2f-a65e-a3f873212220]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG os_brick.utils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updating existing volume attachment record: 3d32d876-bab2-4e6f-b365-4ba37906959a {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:03:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:03:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:03:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7430MB free_disk=24.813213348388672GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 820df13c-9f91-4a7a-a206-907e4f78817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 452d0048-4b11-40f4-b004-d7ded6232e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 465edf8b-56b2-4788-85fb-525665ff16d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 90daf829-e4b2-4f46-a915-d2374bb0896c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.817s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:03:58 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:03:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:00 user nova-compute[75734]: INFO nova.compute.manager [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Unrescuing
Nov 22 16:04:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'flavor' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing instance network info cache due to event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-7331e890-c19f-442d-8f3f-3f2f71ee2f25 req-cdfef9c5-cb5b-4377-a25b-2b549de9dd14 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7331e890-c19f-442d-8f3f-3f2f71ee2f25 req-cdfef9c5-cb5b-4377-a25b-2b549de9dd14 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7331e890-c19f-442d-8f3f-3f2f71ee2f25 req-cdfef9c5-cb5b-4377-a25b-2b549de9dd14 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7331e890-c19f-442d-8f3f-3f2f71ee2f25 req-cdfef9c5-cb5b-4377-a25b-2b549de9dd14 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-7331e890-c19f-442d-8f3f-3f2f71ee2f25 req-cdfef9c5-cb5b-4377-a25b-2b549de9dd14 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:01 user nova-compute[75734]: WARNING nova.compute.manager [req-7331e890-c19f-442d-8f3f-3f2f71ee2f25 req-cdfef9c5-cb5b-4377-a25b-2b549de9dd14 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:04:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updated VIF entry in instance network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.network.neutron [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:01 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance destroyed successfully.
Nov 22 16:04:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2129164d-b11b-4c21-93ed-d0bdb4c653a6 req-fa2ede5e-4c8f-4932-910d-5f14d7d63b80 service nova] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:04:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Creating image(s)
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.260s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.266s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk 1073741824" returned: 0 in 0.063s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:04:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.268s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing instance network info cache due to event network-changed-fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.network.neutron [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Refreshing network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Cannot resize image /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Ensure instance console log exists: /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Start _get_guest_xml network_info=[{"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '3d32d876-bab2-4e6f-b365-4ba37906959a', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '452d0048-4b11-40f4-b004-d7ded6232e54', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'serial': 'e7178529-a0fe-4c6d-a6f5-ebb51c1428de'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-933b94eb-a5c9-485a-aebb-ef9e064032b0 req-ca17d10a-ed78-4dc8-bee8-8d2511714004 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-933b94eb-a5c9-485a-aebb-ef9e064032b0 req-ca17d10a-ed78-4dc8-bee8-8d2511714004 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-933b94eb-a5c9-485a-aebb-ef9e064032b0 req-ca17d10a-ed78-4dc8-bee8-8d2511714004 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-933b94eb-a5c9-485a-aebb-ef9e064032b0 req-ca17d10a-ed78-4dc8-bee8-8d2511714004 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-933b94eb-a5c9-485a-aebb-ef9e064032b0 req-ca17d10a-ed78-4dc8-bee8-8d2511714004 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:03 user nova-compute[75734]: WARNING nova.compute.manager [req-933b94eb-a5c9-485a-aebb-ef9e064032b0 req-ca17d10a-ed78-4dc8-bee8-8d2511714004 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:04:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 16:04:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'vcpu_model' on Instance uuid 452d0048-4b11-40f4-b004-d7ded6232e54 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:04:03 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:04:03 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:04:03 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[226c056e-054f-42ef-96c1-b35c64b7213a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:04:03 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9e5161-7cc1-439f-acd0-fc0d172e601f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de] added
Nov 22 16:04:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf8b2dc-d00a-4e3c-b54c-f5c31015e790]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6e45e-637d-4a4a-846f-84bb163f46af]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrlUGQcY {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrlUGQcY" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe41c5-1a94-4ffe-b579-f9cb408541d9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mrlUGQcY'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcebf03-9f1c-474c-a41b-e4fa14514ceb]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[92efc498-59a1-498e-932a-eca516b29414]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[198f1437-ea91-47ba-92ac-19f4d414a176]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]
Nov 22 16:04:03 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.
Nov 22 16:04:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41eeb45-2cad-4f56-8e95-a5724c9228f6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[147c913e-7360-47b6-b5f3-be1cb1c8f82e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:03 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:04:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[634b9e21-ff66-4362-9e1e-5befd6a66f21]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "465edf8b-56b2-4788-85fb-525665ff16d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "465edf8b-56b2-4788-85fb-525665ff16d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:04 user nova-compute[75734]: INFO nova.compute.manager [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Terminating instance
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updated VIF entry in instance network info cache for port fccdef99-6171-4f48-8296-4e814cf583bb. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2092394a-0075-4b68-ac86-f49b6c89aa38 req-c1535e52-69e4-477d-bb38-980d7070a005 service nova] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Instance destroyed successfully.
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.objects.instance [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'resources' on Instance uuid 465edf8b-56b2-4788-85fb-525665ff16d5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1994107507',display_name='tempest-AttachVolumeNegativeTest-server-1994107507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1994107507',id=23,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUD2YF+nAC2wztUNKZL4XD+YWgk+4tHQGfQ4vITDgE44dXR8bmNNBvEIatnyF7QH+XhWHwVw2eyoklDeo/3TwaQHUvDG+nISfTyb8T2bAffUBxfUdGzAqbK5W0Fy1q73A==',key_name='tempest-keypair-575190232',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-nieql5a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=465edf8b-56b2-4788-85fb-525665ff16d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ab:dc,bridge_name='br-int',has_traffic_filtering=True,id=f3c4b4c5-a556-4ec6-bbee-de8b081a38c1,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c4b4c5-a5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG os_vif [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ab:dc,bridge_name='br-int',has_traffic_filtering=True,id=f3c4b4c5-a556-4ec6-bbee-de8b081a38c1,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c4b4c5-a5') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3c4b4c5-a5, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a4ba329-a778-4dba-897d-94bfb49097b8) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:04:04 user nova-compute[75734]: INFO os_vif [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ab:dc,bridge_name='br-int',has_traffic_filtering=True,id=f3c4b4c5-a556-4ec6-bbee-de8b081a38c1,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c4b4c5-a5')
Nov 22 16:04:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Deleting instance files /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5_del
Nov 22 16:04:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Deletion of /opt/stack/data/nova/instances/465edf8b-56b2-4788-85fb-525665ff16d5_del complete
Nov 22 16:04:04 user nova-compute[75734]: INFO nova.compute.manager [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 22 16:04:04 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:04:04 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.555s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '23233376131666533', 'path': '/dev/sdg'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233376131666533', 'path': '/dev/sdg'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-621823763',display_name='tempest-ServerActionsTestOtherA-server-642600834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-621823763',id=22,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYitI8eNfB1WQDTrUNK8TBNh++AzBu18shj48L/hxhb5AEOAgsFIsMhpBNoR4suzzbEiyjKSGcIzZd665wV8TzuxDG7wFiixXZlqj4I6VD8gFswGXXpxAkFJiROJrAq6g==',key_name='tempest-keypair-1609171650',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-6veorgxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=452d0048-4b11-40f4-b004-d7ded6232e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:04:05 user nova-compute[75734]:   <uuid>452d0048-4b11-40f4-b004-d7ded6232e54</uuid>
Nov 22 16:04:05 user nova-compute[75734]:   <name>instance-00000016</name>
Nov 22 16:04:05 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:04:05 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:04:05 user nova-compute[75734]:   <metadata>
Nov 22 16:04:05 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:04:05 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:04:05 user nova-compute[75734]:       <nova:name>tempest-ServerActionsTestOtherA-server-642600834</nova:name>
Nov 22 16:04:05 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:04:03</nova:creationTime>
Nov 22 16:04:05 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:04:05 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:04:05 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:04:05 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:04:05 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:04:05 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:04:05 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:04:05 user nova-compute[75734]:       <nova:owner>
Nov 22 16:04:05 user nova-compute[75734]:         <nova:user uuid="e9891b862488466e8e46427bbd19f742">tempest-ServerActionsTestOtherA-2146149591-project-member</nova:user>
Nov 22 16:04:05 user nova-compute[75734]:         <nova:project uuid="82865952d35349ffa829cf563d829fbe">tempest-ServerActionsTestOtherA-2146149591</nova:project>
Nov 22 16:04:05 user nova-compute[75734]:       </nova:owner>
Nov 22 16:04:05 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:04:05 user nova-compute[75734]:       <nova:ports>
Nov 22 16:04:05 user nova-compute[75734]:         <nova:port uuid="8096492b-5d84-445a-8b97-d5bcbabef66c">
Nov 22 16:04:05 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 16:04:05 user nova-compute[75734]:         </nova:port>
Nov 22 16:04:05 user nova-compute[75734]:       </nova:ports>
Nov 22 16:04:05 user nova-compute[75734]:     </nova:instance>
Nov 22 16:04:05 user nova-compute[75734]:   </metadata>
Nov 22 16:04:05 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:04:05 user nova-compute[75734]:     <system>
Nov 22 16:04:05 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:04:05 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:04:05 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:04:05 user nova-compute[75734]:       <entry name="serial">452d0048-4b11-40f4-b004-d7ded6232e54</entry>
Nov 22 16:04:05 user nova-compute[75734]:       <entry name="uuid">452d0048-4b11-40f4-b004-d7ded6232e54</entry>
Nov 22 16:04:05 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:04:05 user nova-compute[75734]:     </system>
Nov 22 16:04:05 user nova-compute[75734]:   </sysinfo>
Nov 22 16:04:05 user nova-compute[75734]:   <os>
Nov 22 16:04:05 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:04:05 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:04:05 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:04:05 user nova-compute[75734]:   </os>
Nov 22 16:04:05 user nova-compute[75734]:   <features>
Nov 22 16:04:05 user nova-compute[75734]:     <acpi/>
Nov 22 16:04:05 user nova-compute[75734]:     <apic/>
Nov 22 16:04:05 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:04:05 user nova-compute[75734]:   </features>
Nov 22 16:04:05 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:04:05 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:04:05 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:04:05 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:04:05 user nova-compute[75734]:   </clock>
Nov 22 16:04:05 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:04:05 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:04:05 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:04:05 user nova-compute[75734]:   </cpu>
Nov 22 16:04:05 user nova-compute[75734]:   <devices>
Nov 22 16:04:05 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:04:05 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:04:05 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk"/>
Nov 22 16:04:05 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:04:05 user nova-compute[75734]:     </disk>
Nov 22 16:04:05 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:04:05 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:04:05 user nova-compute[75734]:       <source dev="/dev/sdg"/>
Nov 22 16:04:05 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:04:05 user nova-compute[75734]:       <serial>e7178529-a0fe-4c6d-a6f5-ebb51c1428de</serial>
Nov 22 16:04:05 user nova-compute[75734]:     </disk>
Nov 22 16:04:05 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:04:05 user nova-compute[75734]:       <mac address="fa:16:3e:39:d8:f4"/>
Nov 22 16:04:05 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:04:05 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:04:05 user nova-compute[75734]:       <target dev="tap8096492b-5d"/>
Nov 22 16:04:05 user nova-compute[75734]:     </interface>
Nov 22 16:04:05 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:04:05 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/console.log" append="off"/>
Nov 22 16:04:05 user nova-compute[75734]:     </serial>
Nov 22 16:04:05 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:04:05 user nova-compute[75734]:     <video>
Nov 22 16:04:05 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:04:05 user nova-compute[75734]:     </video>
Nov 22 16:04:05 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:04:05 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:04:05 user nova-compute[75734]:     </rng>
Nov 22 16:04:05 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:04:05 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:04:05 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:04:05 user nova-compute[75734]:     </memballoon>
Nov 22 16:04:05 user nova-compute[75734]:   </devices>
Nov 22 16:04:05 user nova-compute[75734]: </domain>
Nov 22 16:04:05 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-621823763',display_name='tempest-ServerActionsTestOtherA-server-642600834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-621823763',id=22,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYitI8eNfB1WQDTrUNK8TBNh++AzBu18shj48L/hxhb5AEOAgsFIsMhpBNoR4suzzbEiyjKSGcIzZd665wV8TzuxDG7wFiixXZlqj4I6VD8gFswGXXpxAkFJiROJrAq6g==',key_name='tempest-keypair-1609171650',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-6veorgxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=452d0048-4b11-40f4-b004-d7ded6232e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG os_vif [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7137899-9b16-500c-b274-7c167eebd6d2', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8096492b-5d, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8096492b-5d, col_values=(('qos', UUID('135fe87e-2db8-42ec-8aa3-583af637ae91')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8096492b-5d, col_values=(('external_ids', {'iface-id': '8096492b-5d84-445a-8b97-d5bcbabef66c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:d8:f4', 'vm-uuid': '452d0048-4b11-40f4-b004-d7ded6232e54'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:05 user nova-compute[75734]: INFO os_vif [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d')
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No VIF found with MAC fa:16:3e:39:d8:f4, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-changed-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Refreshing instance network info cache due to event network-changed-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] Acquiring lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] Acquired lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Refreshing network info cache for port f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:05 user nova-compute[75734]: WARNING nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:05 user nova-compute[75734]: WARNING nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-vif-unplugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Acquiring lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] No waiting events found dispatching network-vif-unplugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-vif-unplugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Acquiring lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] Lock "465edf8b-56b2-4788-85fb-525665ff16d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] No waiting events found dispatching network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:05 user nova-compute[75734]: WARNING nova.compute.manager [req-fca318b3-344c-4e01-8568-5d8ab6247d6f req-2e4124a2-0fe7-41cc-906b-c8f693625aeb service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received unexpected event network-vif-plugged-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 for instance with vm_state active and task_state deleting.
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:05 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Took 0.90 seconds to deallocate network for instance.
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-54fa9079-599e-4c82-8acc-83d3618a01d1 req-5e76ae75-c71d-4a1d-b798-a0d21400325c service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Received event network-vif-deleted-f3c4b4c5-a556-4ec6-bbee-de8b081a38c1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Updated VIF entry in instance network info cache for port f3c4b4c5-a556-4ec6-bbee-de8b081a38c1. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] [instance: 465edf8b-56b2-4788-85fb-525665ff16d5] Updating instance_info_cache with network_info: [{"id": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "address": "fa:16:3e:e1:ab:dc", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c4b4c5-a5", "ovs_interfaceid": "f3c4b4c5-a556-4ec6-bbee-de8b081a38c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c21ee3e7-adf3-4021-9f3f-2a91e86bd39d req-bcfc0bc4-432f-4a3f-8186-59451c315d73 service nova] Releasing lock "refresh_cache-465edf8b-56b2-4788-85fb-525665ff16d5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7e9d1894-3195-467b-ab41-89fa13175643 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:06 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Deleted allocations for instance 465edf8b-56b2-4788-85fb-525665ff16d5
Nov 22 16:04:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d246181a-6d65-479f-9cdb-c6d1088f0355 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "465edf8b-56b2-4788-85fb-525665ff16d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:07 user nova-compute[75734]: WARNING nova.compute.manager [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received unexpected event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with vm_state active and task_state rebuild_spawning.
Nov 22 16:04:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:07 user nova-compute[75734]: WARNING nova.compute.manager [req-5728eff1-0363-4e90-8aa9-8f67a56120e9 req-ae0a7cb0-73ec-44a8-b424-208c13ec484d service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received unexpected event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with vm_state active and task_state rebuild_spawning.
Nov 22 16:04:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:04:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:04:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance spawned successfully.
Nov 22 16:04:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75734) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 22 16:04:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8a401cfd-0f6b-4109-a99e-17390d52a217 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:33 user nova-compute[75734]: INFO nova.compute.manager [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Detaching volume 6d41bf7f-f664-4884-8011-de8342796faa
Nov 22 16:04:33 user nova-compute[75734]: INFO nova.virt.block_device [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Attempting to driver detach volume 6d41bf7f-f664-4884-8011-de8342796faa from mountpoint /dev/vdb
Nov 22 16:04:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Attempting to detach device vdb from instance 820df13c-9f91-4a7a-a206-907e4f78817b from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:04:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:04:33 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:04:33 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:04:33 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:04:33 user nova-compute[75734]:   <serial>6d41bf7f-f664-4884-8011-de8342796faa</serial>
Nov 22 16:04:33 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:04:33 user nova-compute[75734]: </disk>
Nov 22 16:04:33 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:04:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Successfully detached device vdb from instance 820df13c-9f91-4a7a-a206-907e4f78817b from the persistent domain config.
Nov 22 16:04:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 820df13c-9f91-4a7a-a206-907e4f78817b from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:04:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:04:33 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:04:33 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:04:33 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:04:33 user nova-compute[75734]:   <serial>6d41bf7f-f664-4884-8011-de8342796faa</serial>
Nov 22 16:04:33 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:04:33 user nova-compute[75734]: </disk>
Nov 22 16:04:33 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:04:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:04:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:04:36 user nova-compute[75734]: INFO nova.compute.claims [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Claim successful on node user
Nov 22 16:04:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:04:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:04:36 user nova-compute[75734]: INFO nova.virt.block_device [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Booting with volume-backed-image 9f27db0a-f3d9-4491-93dc-75dd864eab9b at /dev/vda
Nov 22 16:04:36 user nova-compute[75734]: DEBUG nova.policy [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dc99ff4c7054545a10673afb2cf930b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234cf12714b74b12aa027c8fff2e784e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:04:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Successfully created port: 66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Successfully updated port: 66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-changed-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Refreshing instance network info cache due to event network-changed-66f1f97a-8d33-486b-86ec-59754c68b651. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] Acquiring lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updating instance_info_cache with network_info: [{"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance network_info: |[{"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] Acquired lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Refreshing network info cache for port 66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:04:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updated VIF entry in instance network info cache for port 66f1f97a-8d33-486b-86ec-59754c68b651. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:04:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updating instance_info_cache with network_info: [{"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1c896756-7fe2-4aae-ac96-866c835df7c3 req-8a05db43-499a-4d5a-8832-3d8e6c1b5a1a service nova] Releasing lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG os_brick.utils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0776d1-bb56-4c4e-8019-2407e6f8d876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d840bbc-8d77-444c-8b60-eb606606a8f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b913b0c-9164-40c0-bd31-18e96b46a5b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4436ea4c-1094-483b-8173-57e6ef34cc03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:04:42 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:04:42 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd8bc1-ece9-4596-a191-bafa0a4558f2]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG os_brick.utils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:04:42 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updating existing volume attachment record: 09ac064b-1308-4c8e-b5fc-ebd6ae630a13 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:04:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:04:49 user nova-compute[75734]: INFO nova.compute.claims [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Claim successful on node user
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:04:49 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Creating image(s)
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Ensure instance console log exists: /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Start _get_guest_xml network_info=[{"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '09ac064b-1308-4c8e-b5fc-ebd6ae630a13', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdbGXOfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cee17c90-5f3f-4455-a696-4ba11cd02451', 'attached_at': '', 'detached_at': '', 'volume_id': '3b4a34a8-c78f-4372-9828-4f707d420f99', 'serial': '3b4a34a8-c78f-4372-9828-4f707d420f99'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:04:49 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:04:49 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdbGXOfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:04:49 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:04:49 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:04:49 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d7c8e-f6eb-48b4-a983-88cbf9e0564a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:04:49 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8f7bb-8c71-48df-ad9a-4410bb618fd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99] added
Nov 22 16:04:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a65b0-8f55-4d2b-a047-11ba5a9c6908]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.216s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a217c497-e937-418e-87fa-f46f5176de14]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdbGXOfh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdbGXOfh" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c48c74-e28b-4d70-8aef-45505a7a9a81]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdbGXOfh'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26fdc5d-0742-4106-9e99-5a30e7864fd8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c112e43-5b2c-4d09-9b33-6fec58acd5cd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:49 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:04:49 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:04:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb423c-13b5-4c93-a39a-1ee90a583f0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260]
Nov 22 16:04:49 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260] successful.
Nov 22 16:04:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[03002f57-fa75-436d-b760-c249a91cce10]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG nova.policy [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2e6a31c87c74976b0d7aae6280cfd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1907da4ebb34a77ab650d943f728f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: INFO nova.virt.block_device [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Booting with volume d6b8dab8-3e7c-4e0e-afee-a43c002be647 at /dev/vda
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[faad7b9a-86e9-460f-b67b-808391e15e14]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:50 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:50 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:50 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.544s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[13135fcc-a7eb-4957-8157-6ae4ec4ee963]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdbGXOfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.utils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e204b-1ea9-4647-ad36-4adaa5960419]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa683367-ac2a-45c1-8dec-dd117687a04d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[35216358-bc42-4de0-9058-690b5fa626ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7010b59-01e4-4853-9618-6631381090de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:04:50 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf21df2d-f467-4533-ae6c-89fddd9b21f1]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG os_brick.utils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updating existing volume attachment record: cd5dcedf-f18c-41d4-acb0-d99e344e58b9 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Successfully created port: b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.584s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== connect_volume: return (1585ms) {'type': 'block', 'scsi_wwn': '26562343933306532', 'path': '/dev/sdh'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562343933306532', 'path': '/dev/sdh'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-152740879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-152740879',id=25,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-bxm0e8ww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:04:37Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=cee17c90-5f3f-4455-a696-4ba11cd02451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'pci_devices' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:04:51 user nova-compute[75734]:   <uuid>cee17c90-5f3f-4455-a696-4ba11cd02451</uuid>
Nov 22 16:04:51 user nova-compute[75734]:   <name>instance-00000019</name>
Nov 22 16:04:51 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:04:51 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:04:51 user nova-compute[75734]:   <metadata>
Nov 22 16:04:51 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:04:51 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:04:51 user nova-compute[75734]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-152740879</nova:name>
Nov 22 16:04:51 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:04:49</nova:creationTime>
Nov 22 16:04:51 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:04:51 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:04:51 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:04:51 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:04:51 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:04:51 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:04:51 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:04:51 user nova-compute[75734]:       <nova:owner>
Nov 22 16:04:51 user nova-compute[75734]:         <nova:user uuid="5dc99ff4c7054545a10673afb2cf930b">tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member</nova:user>
Nov 22 16:04:51 user nova-compute[75734]:         <nova:project uuid="234cf12714b74b12aa027c8fff2e784e">tempest-ServerBootFromVolumeStableRescueTest-1333150873</nova:project>
Nov 22 16:04:51 user nova-compute[75734]:       </nova:owner>
Nov 22 16:04:51 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:04:51 user nova-compute[75734]:       <nova:ports>
Nov 22 16:04:51 user nova-compute[75734]:         <nova:port uuid="66f1f97a-8d33-486b-86ec-59754c68b651">
Nov 22 16:04:51 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 16:04:51 user nova-compute[75734]:         </nova:port>
Nov 22 16:04:51 user nova-compute[75734]:       </nova:ports>
Nov 22 16:04:51 user nova-compute[75734]:     </nova:instance>
Nov 22 16:04:51 user nova-compute[75734]:   </metadata>
Nov 22 16:04:51 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:04:51 user nova-compute[75734]:     <system>
Nov 22 16:04:51 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:04:51 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:04:51 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:04:51 user nova-compute[75734]:       <entry name="serial">cee17c90-5f3f-4455-a696-4ba11cd02451</entry>
Nov 22 16:04:51 user nova-compute[75734]:       <entry name="uuid">cee17c90-5f3f-4455-a696-4ba11cd02451</entry>
Nov 22 16:04:51 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:04:51 user nova-compute[75734]:     </system>
Nov 22 16:04:51 user nova-compute[75734]:   </sysinfo>
Nov 22 16:04:51 user nova-compute[75734]:   <os>
Nov 22 16:04:51 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:04:51 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:04:51 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:04:51 user nova-compute[75734]:   </os>
Nov 22 16:04:51 user nova-compute[75734]:   <features>
Nov 22 16:04:51 user nova-compute[75734]:     <acpi/>
Nov 22 16:04:51 user nova-compute[75734]:     <apic/>
Nov 22 16:04:51 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:04:51 user nova-compute[75734]:   </features>
Nov 22 16:04:51 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:04:51 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:04:51 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:04:51 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:04:51 user nova-compute[75734]:   </clock>
Nov 22 16:04:51 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:04:51 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:04:51 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:04:51 user nova-compute[75734]:   </cpu>
Nov 22 16:04:51 user nova-compute[75734]:   <devices>
Nov 22 16:04:51 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:04:51 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:04:51 user nova-compute[75734]:       <source dev="/dev/sdh"/>
Nov 22 16:04:51 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:04:51 user nova-compute[75734]:       <serial>3b4a34a8-c78f-4372-9828-4f707d420f99</serial>
Nov 22 16:04:51 user nova-compute[75734]:     </disk>
Nov 22 16:04:51 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:04:51 user nova-compute[75734]:       <mac address="fa:16:3e:30:46:d0"/>
Nov 22 16:04:51 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:04:51 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:04:51 user nova-compute[75734]:       <target dev="tap66f1f97a-8d"/>
Nov 22 16:04:51 user nova-compute[75734]:     </interface>
Nov 22 16:04:51 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:04:51 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/console.log" append="off"/>
Nov 22 16:04:51 user nova-compute[75734]:     </serial>
Nov 22 16:04:51 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:04:51 user nova-compute[75734]:     <video>
Nov 22 16:04:51 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:04:51 user nova-compute[75734]:     </video>
Nov 22 16:04:51 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:04:51 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:04:51 user nova-compute[75734]:     </rng>
Nov 22 16:04:51 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:04:51 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:04:51 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:04:51 user nova-compute[75734]:     </memballoon>
Nov 22 16:04:51 user nova-compute[75734]:   </devices>
Nov 22 16:04:51 user nova-compute[75734]: </domain>
Nov 22 16:04:51 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-152740879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-152740879',id=25,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-bxm0e8ww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:04:37Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=cee17c90-5f3f-4455-a696-4ba11cd02451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG os_vif [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35286342-7b24-5d12-a0e8-ef13040f8a7e', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66f1f97a-8d, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66f1f97a-8d, col_values=(('qos', UUID('7e50b1ad-9d89-4074-9684-922d5dd25b0c')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66f1f97a-8d, col_values=(('external_ids', {'iface-id': '66f1f97a-8d33-486b-86ec-59754c68b651', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:46:d0', 'vm-uuid': 'cee17c90-5f3f-4455-a696-4ba11cd02451'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:51 user nova-compute[75734]: INFO os_vif [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d')
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No VIF found with MAC fa:16:3e:30:46:d0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Successfully updated port: b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquired lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event network-changed-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Refreshing instance network info cache due to event network-changed-b9eb5093-2818-45ae-ba0d-29ef0405420e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:04:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] Acquiring lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updating instance_info_cache with network_info: [{"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Releasing lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance network_info: |[{"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] Acquired lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Refreshing network info cache for port b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updated VIF entry in instance network info cache for port b9eb5093-2818-45ae-ba0d-29ef0405420e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updating instance_info_cache with network_info: [{"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3666f31f-b921-4b72-871f-5df1e268a9ff req-81492e94-8d02-4a3a-aa28-60b20ae68190 service nova] Releasing lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-10433c62-9ce5-42a9-8ae4-1b00b4196531 req-67f07e83-27f7-428f-8fcb-77991183fcaa service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-10433c62-9ce5-42a9-8ae4-1b00b4196531 req-67f07e83-27f7-428f-8fcb-77991183fcaa service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-10433c62-9ce5-42a9-8ae4-1b00b4196531 req-67f07e83-27f7-428f-8fcb-77991183fcaa service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-10433c62-9ce5-42a9-8ae4-1b00b4196531 req-67f07e83-27f7-428f-8fcb-77991183fcaa service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-10433c62-9ce5-42a9-8ae4-1b00b4196531 req-67f07e83-27f7-428f-8fcb-77991183fcaa service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:52 user nova-compute[75734]: WARNING nova.compute.manager [req-10433c62-9ce5-42a9-8ae4-1b00b4196531 req-67f07e83-27f7-428f-8fcb-77991183fcaa service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state building and task_state spawning.
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:04:53 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 820df13c-9f91-4a7a-a206-907e4f78817b is timed out.
Nov 22 16:04:53 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Successfully detached device vdb from instance 820df13c-9f91-4a7a-a206-907e4f78817b from the live domain config.
Nov 22 16:04:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEnbDNwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:04:53 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6fb943-201b-4c78-be0f-624f2b984f1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:04:53 user nova-compute[75734]: No targets found.
Nov 22 16:04:53 user nova-compute[75734]: iSNS:
Nov 22 16:04:53 user nova-compute[75734]: No targets found.
Nov 22 16:04:53 user nova-compute[75734]: STATIC:
Nov 22 16:04:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:04:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:04:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:04:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:04:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:04:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:04:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:04:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:04:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:04:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:04:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:04:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:04:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa
Nov 22 16:04:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:04:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:04:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b
Nov 22 16:04:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:04:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:04:53 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:04:53 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:04:53 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:04:53 user nova-compute[75734]: FIRMWARE:
Nov 22 16:04:53 user nova-compute[75734]: No targets found.
Nov 22 16:04:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:04:53 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:04:53 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1999f8c-398a-40bd-9712-68926dc470f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c12b75-8262-4aa7-b0f1-cc712b1f024f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:53 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7f1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9869b9-0ab7-434f-bc32-851a995b62e0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99d95fb-caf3-4f35-aadf-420546a15385]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea627eb-ef94-42bb-8dea-02f018cebf2b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c83842-f01b-4c43-b105-9d84a37716b7]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e7b8c-ea23-48c9-af54-f5d0b843f280]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca584d1-16d8-4b70-aab6-7fe6112eb71c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260]
Nov 22 16:04:53 user nova-compute[75734]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa, portal: 172.16.0.220,3260] successful.
Nov 22 16:04:53 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d41bf7f-f664-4884-8011-de8342796faa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9c6d81-ced4-499a-b8bd-e3b1ea2f6cab]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] <== disconnect_volume: return (340ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:04:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance spawned successfully.
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'flavor' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b3d2a305-1a75-4726-ad76-a311c8e47144 tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.750s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-f046646e-77d7-407e-96bc-19523803ac3f req-57bb8f8c-e736-49a0-87c8-ea23c52c6a9b service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f046646e-77d7-407e-96bc-19523803ac3f req-57bb8f8c-e736-49a0-87c8-ea23c52c6a9b service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f046646e-77d7-407e-96bc-19523803ac3f req-57bb8f8c-e736-49a0-87c8-ea23c52c6a9b service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f046646e-77d7-407e-96bc-19523803ac3f req-57bb8f8c-e736-49a0-87c8-ea23c52c6a9b service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-f046646e-77d7-407e-96bc-19523803ac3f req-57bb8f8c-e736-49a0-87c8-ea23c52c6a9b service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:04:54 user nova-compute[75734]: WARNING nova.compute.manager [req-f046646e-77d7-407e-96bc-19523803ac3f req-57bb8f8c-e736-49a0-87c8-ea23c52c6a9b service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state building and task_state spawning.
Nov 22 16:04:54 user nova-compute[75734]: INFO nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 22 16:04:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:55 user nova-compute[75734]: INFO nova.compute.manager [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Took 18.81 seconds to build instance.
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e3fcb648-d15b-4f73-a759-22fa789ea9c2 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.910s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:55 user nova-compute[75734]: INFO nova.compute.manager [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Detaching volume 2056b2dc-f8f4-4eb0-9446-1a7a38096f3b
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:55 user nova-compute[75734]: INFO nova.virt.block_device [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Attempting to driver detach volume 2056b2dc-f8f4-4eb0-9446-1a7a38096f3b from mountpoint /dev/vdb
Nov 22 16:04:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Attempting to detach device vdb from instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:04:55 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:04:55 user nova-compute[75734]:   <source dev="/dev/sde"/>
Nov 22 16:04:55 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:04:55 user nova-compute[75734]:   <serial>2056b2dc-f8f4-4eb0-9446-1a7a38096f3b</serial>
Nov 22 16:04:55 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:04:55 user nova-compute[75734]: </disk>
Nov 22 16:04:55 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:04:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully detached device vdb from instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 from the persistent domain config.
Nov 22 16:04:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:04:55 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:04:55 user nova-compute[75734]:   <source dev="/dev/sde"/>
Nov 22 16:04:55 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:04:55 user nova-compute[75734]:   <serial>2056b2dc-f8f4-4eb0-9446-1a7a38096f3b</serial>
Nov 22 16:04:55 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:04:55 user nova-compute[75734]: </disk>
Nov 22 16:04:55 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:04:57 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Creating image(s)
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Ensure instance console log exists: /opt/stack/data/nova/instances/faaf4403-3509-4b15-af7b-37fefceafa90/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Start _get_guest_xml network_info=[{"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'cd5dcedf-f18c-41d4-acb0-d99e344e58b9', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhvLNPdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'faaf4403-3509-4b15-af7b-37fefceafa90', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6b8dab8-3e7c-4e0e-afee-a43c002be647', 'serial': 'd6b8dab8-3e7c-4e0e-afee-a43c002be647'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:04:57 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:04:57 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhvLNPdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:04:57 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:04:57 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:04:57 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c7ac18-a45e-4c0f-b828-a4dc58bbff5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:04:57 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[073bd305-f8b6-4c6d-9b54-223b16dfd26a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647] added
Nov 22 16:04:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d690230-8d55-440f-b42f-07d4acfbf32e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8b9a22-7c7c-4de4-a6bb-741b0018e784]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhvLNPdt {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhvLNPdt" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef35b0-8882-43ca-937e-939b7f47688b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AhvLNPdt'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d65c0-c692-46ee-9af4-73a11f2117df]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3205e8eb-5f3d-4aae-ba97-e5787abb5c7a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78203e1-39f2-4ff9-804c-09b0fa1ca0cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260]
Nov 22 16:04:57 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260] successful.
Nov 22 16:04:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d84e70-1dbe-4a2f-8d0d-0353c7f0c479]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1fbe23-8cbf-4ae2-8104-d556ee1b0e6e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:04:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aefdbc-3f31-440c-8490-8190ac8545d6]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhvLNPdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26430393533323036', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430393533323036', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-368242086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-368242086',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1lFGCe2iwvxzcqx/e0m218xdfEp4o6zmPD135gbBimZfV3uea5k9we8/wkfVlBFFAXo5oOOEZdO+JYh7H8YExi8cSWlkVPmnJYwesCHup3pLg3ssqFQsdmV/JYQXT84Q==',key_name='tempest-keypair-378398179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1907da4ebb34a77ab650d943f728f98',ramdisk_id='',reservation_id='r-vyfkrzww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1321099151',owner_user_name='tempest-ServerActionsV293TestJSON-1321099151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e6a31c87c74976b0d7aae6280cfd25',uuid=faaf4403-3509-4b15-af7b-37fefceafa90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converting VIF {"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lazy-loading 'pci_devices' on Instance uuid faaf4403-3509-4b15-af7b-37fefceafa90 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:04:58 user nova-compute[75734]:   <uuid>faaf4403-3509-4b15-af7b-37fefceafa90</uuid>
Nov 22 16:04:58 user nova-compute[75734]:   <name>instance-0000001a</name>
Nov 22 16:04:58 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:04:58 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:04:58 user nova-compute[75734]:   <metadata>
Nov 22 16:04:58 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:04:58 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:04:58 user nova-compute[75734]:       <nova:name>tempest-ServerActionsV293TestJSON-server-368242086</nova:name>
Nov 22 16:04:58 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:04:57</nova:creationTime>
Nov 22 16:04:58 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:04:58 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:04:58 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:04:58 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:04:58 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:04:58 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:04:58 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:04:58 user nova-compute[75734]:       <nova:owner>
Nov 22 16:04:58 user nova-compute[75734]:         <nova:user uuid="a2e6a31c87c74976b0d7aae6280cfd25">tempest-ServerActionsV293TestJSON-1321099151-project-member</nova:user>
Nov 22 16:04:58 user nova-compute[75734]:         <nova:project uuid="f1907da4ebb34a77ab650d943f728f98">tempest-ServerActionsV293TestJSON-1321099151</nova:project>
Nov 22 16:04:58 user nova-compute[75734]:       </nova:owner>
Nov 22 16:04:58 user nova-compute[75734]:       <nova:ports>
Nov 22 16:04:58 user nova-compute[75734]:         <nova:port uuid="b9eb5093-2818-45ae-ba0d-29ef0405420e">
Nov 22 16:04:58 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 16:04:58 user nova-compute[75734]:         </nova:port>
Nov 22 16:04:58 user nova-compute[75734]:       </nova:ports>
Nov 22 16:04:58 user nova-compute[75734]:     </nova:instance>
Nov 22 16:04:58 user nova-compute[75734]:   </metadata>
Nov 22 16:04:58 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:04:58 user nova-compute[75734]:     <system>
Nov 22 16:04:58 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:04:58 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:04:58 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:04:58 user nova-compute[75734]:       <entry name="serial">faaf4403-3509-4b15-af7b-37fefceafa90</entry>
Nov 22 16:04:58 user nova-compute[75734]:       <entry name="uuid">faaf4403-3509-4b15-af7b-37fefceafa90</entry>
Nov 22 16:04:58 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:04:58 user nova-compute[75734]:     </system>
Nov 22 16:04:58 user nova-compute[75734]:   </sysinfo>
Nov 22 16:04:58 user nova-compute[75734]:   <os>
Nov 22 16:04:58 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:04:58 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:04:58 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:04:58 user nova-compute[75734]:   </os>
Nov 22 16:04:58 user nova-compute[75734]:   <features>
Nov 22 16:04:58 user nova-compute[75734]:     <acpi/>
Nov 22 16:04:58 user nova-compute[75734]:     <apic/>
Nov 22 16:04:58 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:04:58 user nova-compute[75734]:   </features>
Nov 22 16:04:58 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:04:58 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:04:58 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:04:58 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:04:58 user nova-compute[75734]:   </clock>
Nov 22 16:04:58 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:04:58 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:04:58 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:04:58 user nova-compute[75734]:   </cpu>
Nov 22 16:04:58 user nova-compute[75734]:   <devices>
Nov 22 16:04:58 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:04:58 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:04:58 user nova-compute[75734]:       <source dev="/dev/sdc"/>
Nov 22 16:04:58 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:04:58 user nova-compute[75734]:       <serial>d6b8dab8-3e7c-4e0e-afee-a43c002be647</serial>
Nov 22 16:04:58 user nova-compute[75734]:     </disk>
Nov 22 16:04:58 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:04:58 user nova-compute[75734]:       <mac address="fa:16:3e:3f:ca:21"/>
Nov 22 16:04:58 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:04:58 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:04:58 user nova-compute[75734]:       <target dev="tapb9eb5093-28"/>
Nov 22 16:04:58 user nova-compute[75734]:     </interface>
Nov 22 16:04:58 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:04:58 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/faaf4403-3509-4b15-af7b-37fefceafa90/console.log" append="off"/>
Nov 22 16:04:58 user nova-compute[75734]:     </serial>
Nov 22 16:04:58 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:04:58 user nova-compute[75734]:     <video>
Nov 22 16:04:58 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:04:58 user nova-compute[75734]:     </video>
Nov 22 16:04:58 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:04:58 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:04:58 user nova-compute[75734]:     </rng>
Nov 22 16:04:58 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:04:58 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:04:58 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:04:58 user nova-compute[75734]:     </memballoon>
Nov 22 16:04:58 user nova-compute[75734]:   </devices>
Nov 22 16:04:58 user nova-compute[75734]: </domain>
Nov 22 16:04:58 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-368242086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-368242086',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1lFGCe2iwvxzcqx/e0m218xdfEp4o6zmPD135gbBimZfV3uea5k9we8/wkfVlBFFAXo5oOOEZdO+JYh7H8YExi8cSWlkVPmnJYwesCHup3pLg3ssqFQsdmV/JYQXT84Q==',key_name='tempest-keypair-378398179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1907da4ebb34a77ab650d943f728f98',ramdisk_id='',reservation_id='r-vyfkrzww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1321099151',owner_user_name='tempest-ServerActionsV293TestJSON-1321099151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e6a31c87c74976b0d7aae6280cfd25',uuid=faaf4403-3509-4b15-af7b-37fefceafa90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converting VIF {"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG os_vif [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3358c87b-1d2d-55e3-b263-40a8de6cba63', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9eb5093-28, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9eb5093-28, col_values=(('qos', UUID('457ea5f9-3e5c-4905-a07f-e05ba8da1a07')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9eb5093-28, col_values=(('external_ids', {'iface-id': 'b9eb5093-2818-45ae-ba0d-29ef0405420e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:ca:21', 'vm-uuid': 'faaf4403-3509-4b15-af7b-37fefceafa90'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:04:58 user nova-compute[75734]: INFO os_vif [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28')
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] No VIF found with MAC fa:16:3e:3f:ca:21, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:04:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:04:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:05:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7416MB free_disk=24.801136016845703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-2d94746b-66a8-48ca-b9bc-7d3bd9c162c5 req-d023ac8e-f413-4f22-a422-4aad52340a96 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2d94746b-66a8-48ca-b9bc-7d3bd9c162c5 req-d023ac8e-f413-4f22-a422-4aad52340a96 service nova] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2d94746b-66a8-48ca-b9bc-7d3bd9c162c5 req-d023ac8e-f413-4f22-a422-4aad52340a96 service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2d94746b-66a8-48ca-b9bc-7d3bd9c162c5 req-d023ac8e-f413-4f22-a422-4aad52340a96 service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-2d94746b-66a8-48ca-b9bc-7d3bd9c162c5 req-d023ac8e-f413-4f22-a422-4aad52340a96 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] No waiting events found dispatching network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:00 user nova-compute[75734]: WARNING nova.compute.manager [req-2d94746b-66a8-48ca-b9bc-7d3bd9c162c5 req-d023ac8e-f413-4f22-a422-4aad52340a96 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received unexpected event network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e for instance with vm_state building and task_state spawning.
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 820df13c-9f91-4a7a-a206-907e4f78817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5dbde2ab-53f7-46db-a454-bcc8980833dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 452d0048-4b11-40f4-b004-d7ded6232e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 90daf829-e4b2-4f46-a915-d2374bb0896c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cee17c90-5f3f-4455-a696-4ba11cd02451 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance faaf4403-3509-4b15-af7b-37fefceafa90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:01 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:05:01 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:05:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:05:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:05:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance spawned successfully.
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-f67b1383-4bf3-4242-be6e-8a0c4d82354b req-8182266b-0d51-4921-aa30-cbd79d6b342f service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f67b1383-4bf3-4242-be6e-8a0c4d82354b req-8182266b-0d51-4921-aa30-cbd79d6b342f service nova] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f67b1383-4bf3-4242-be6e-8a0c4d82354b req-8182266b-0d51-4921-aa30-cbd79d6b342f service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f67b1383-4bf3-4242-be6e-8a0c4d82354b req-8182266b-0d51-4921-aa30-cbd79d6b342f service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-f67b1383-4bf3-4242-be6e-8a0c4d82354b req-8182266b-0d51-4921-aa30-cbd79d6b342f service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] No waiting events found dispatching network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:02 user nova-compute[75734]: WARNING nova.compute.manager [req-f67b1383-4bf3-4242-be6e-8a0c4d82354b req-8182266b-0d51-4921-aa30-cbd79d6b342f service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received unexpected event network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e for instance with vm_state building and task_state spawning.
Nov 22 16:05:02 user nova-compute[75734]: INFO nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:05:02 user nova-compute[75734]: INFO nova.compute.manager [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Took 13.38 seconds to build instance.
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2e07c96f-6dc1-45c2-bcaa-e352237ccff3 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.509s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [{"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-820df13c-9f91-4a7a-a206-907e4f78817b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:05:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:16 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 is timed out.
Nov 22 16:05:16 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully detached device vdb from instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88 from the live domain config.
Nov 22 16:05:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EawGryom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:05:16 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2552ea-9f57-4d4e-ade3-39f868cd0745]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:05:16 user nova-compute[75734]: No targets found.
Nov 22 16:05:16 user nova-compute[75734]: iSNS:
Nov 22 16:05:16 user nova-compute[75734]: No targets found.
Nov 22 16:05:16 user nova-compute[75734]: STATIC:
Nov 22 16:05:16 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:05:16 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:16 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:16 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:05:16 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:16 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:16 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:05:16 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:16 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:16 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:05:16 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:16 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:16 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647
Nov 22 16:05:16 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:16 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:16 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b
Nov 22 16:05:16 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:16 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:16 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:05:16 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:16 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:16 user nova-compute[75734]: FIRMWARE:
Nov 22 16:05:16 user nova-compute[75734]: No targets found.
Nov 22 16:05:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:05:16 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:05:16 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e32ec5-224e-4271-b5e6-c3e6c894eab6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[26789ad9-1da0-4157-bfca-38af0c8dc012]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:16 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7be3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b'): ({'sde'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Removing single pathed devices sde {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a13837-5ef4-4b42-977c-db9bda8eb3b7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3ac59f-7eb8-434e-8fc4-45fdecef8df9]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flushing IO for device /dev/sde {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[675d39ee-bd20-4c7f-94fc-339805b2dc16]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13fabe8-531d-472d-8ba5-b81c7fcada12]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0a12b-91f6-4f6a-b416-860addcb2eb0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4301afa5-01e2-4db7-ad31-ed7433859055]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260]
Nov 22 16:05:16 user nova-compute[75734]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b, portal: 172.16.0.220,3260] successful.
Nov 22 16:05:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056b2dc-f8f4-4eb0-9446-1a7a38096f3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a981b9c-a108-4e40-a5ea-3722569fa319]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== disconnect_volume: return (327ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:05:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:05:17 user nova-compute[75734]: DEBUG nova.objects.instance [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid a9bd2406-f5bb-4f1e-bae4-c0654554ac88 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:05:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-22811550-d4fe-4e6b-be7c-83640eed1f56 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.013s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:23 user nova-compute[75734]: INFO nova.compute.manager [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Terminating instance
Nov 22 16:05:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-c5d8dad3-8235-4f7e-885d-3768b1384cac req-b2d9b4c3-ed7e-4792-9ab0-62c9f1a8718a service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c5d8dad3-8235-4f7e-885d-3768b1384cac req-b2d9b4c3-ed7e-4792-9ab0-62c9f1a8718a service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c5d8dad3-8235-4f7e-885d-3768b1384cac req-b2d9b4c3-ed7e-4792-9ab0-62c9f1a8718a service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c5d8dad3-8235-4f7e-885d-3768b1384cac req-b2d9b4c3-ed7e-4792-9ab0-62c9f1a8718a service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-c5d8dad3-8235-4f7e-885d-3768b1384cac req-b2d9b4c3-ed7e-4792-9ab0-62c9f1a8718a service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-c5d8dad3-8235-4f7e-885d-3768b1384cac req-b2d9b4c3-ed7e-4792-9ab0-62c9f1a8718a service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-unplugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:05:24 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Instance destroyed successfully.
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lazy-loading 'resources' on Instance uuid 820df13c-9f91-4a7a-a206-907e4f78817b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1965206383',display_name='tempest-ServerStableDeviceRescueTest-server-1965206383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1965206383',id=17,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUk2XbUSRZkPVQX50ldN8fglFEZrOrx6bWFhvyl1nOEoIPJXUueaINERYMALQvtH7Yjd1nNJqLOm5HiLTN9Fahitj0OaOxYevgY2rTMJMdhFvy54R+Qnw3LFF1LeYoI7Q==',key_name='tempest-keypair-1287154213',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7cf712589524e98b21c4bbc6ff7e8b6',ramdisk_id='',reservation_id='r-2lxxk9sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1050690507',owner_user_name='tempest-ServerStableDeviceRescueTest-1050690507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5dd895a5e6e4c10a1a99a172d47b189',uuid=820df13c-9f91-4a7a-a206-907e4f78817b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converting VIF {"id": "fccdef99-6171-4f48-8296-4e814cf583bb", "address": "fa:16:3e:f7:34:18", "network": {"id": "6704ce0a-9b4b-45b5-baa0-0991fe61cc38", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1526234355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7cf712589524e98b21c4bbc6ff7e8b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccdef99-61", "ovs_interfaceid": "fccdef99-6171-4f48-8296-4e814cf583bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG os_vif [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfccdef99-61, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f9034d9-37c7-4d50-86cf-ce4a6bc9b8a9) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:24 user nova-compute[75734]: INFO os_vif [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:34:18,bridge_name='br-int',has_traffic_filtering=True,id=fccdef99-6171-4f48-8296-4e814cf583bb,network=Network(6704ce0a-9b4b-45b5-baa0-0991fe61cc38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccdef99-61')
Nov 22 16:05:24 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Deleting instance files /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b_del
Nov 22 16:05:24 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Deletion of /opt/stack/data/nova/instances/820df13c-9f91-4a7a-a206-907e4f78817b_del complete
Nov 22 16:05:24 user nova-compute[75734]: INFO nova.compute.manager [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 16:05:24 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:05:24 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:05:25 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:05:25 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Took 0.83 seconds to deallocate network for instance.
Nov 22 16:05:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-0f8ed242-0f2b-47cf-bcff-9c5c36eed587 req-97b49412-1754-4b5e-b6e3-df92a86732ab service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-deleted-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:25 user nova-compute[75734]: INFO nova.compute.manager [req-0f8ed242-0f2b-47cf-bcff-9c5c36eed587 req-97b49412-1754-4b5e-b6e3-df92a86732ab service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Neutron deleted interface fccdef99-6171-4f48-8296-4e814cf583bb; detaching it from the instance and deleting it from the info cache
Nov 22 16:05:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-0f8ed242-0f2b-47cf-bcff-9c5c36eed587 req-97b49412-1754-4b5e-b6e3-df92a86732ab service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:05:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-0f8ed242-0f2b-47cf-bcff-9c5c36eed587 req-97b49412-1754-4b5e-b6e3-df92a86732ab service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Detach interface failed, port_id=fccdef99-6171-4f48-8296-4e814cf583bb, reason: Instance 820df13c-9f91-4a7a-a206-907e4f78817b could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:05:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:25 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:05:25 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:05:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:25 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Deleted allocations for instance 820df13c-9f91-4a7a-a206-907e4f78817b
Nov 22 16:05:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f218440f-c419-4fad-b9bd-ade102e4f43f tempest-ServerStableDeviceRescueTest-1050690507 tempest-ServerStableDeviceRescueTest-1050690507-project-member] Lock "820df13c-9f91-4a7a-a206-907e4f78817b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e8d9fd5-893e-4d00-a6ec-86642dd276ec req-8d35f103-8670-4eab-972e-90a88d2fd420 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e8d9fd5-893e-4d00-a6ec-86642dd276ec req-8d35f103-8670-4eab-972e-90a88d2fd420 service nova] Acquiring lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e8d9fd5-893e-4d00-a6ec-86642dd276ec req-8d35f103-8670-4eab-972e-90a88d2fd420 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2e8d9fd5-893e-4d00-a6ec-86642dd276ec req-8d35f103-8670-4eab-972e-90a88d2fd420 service nova] Lock "820df13c-9f91-4a7a-a206-907e4f78817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-2e8d9fd5-893e-4d00-a6ec-86642dd276ec req-8d35f103-8670-4eab-972e-90a88d2fd420 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] No waiting events found dispatching network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:26 user nova-compute[75734]: WARNING nova.compute.manager [req-2e8d9fd5-893e-4d00-a6ec-86642dd276ec req-8d35f103-8670-4eab-972e-90a88d2fd420 service nova] [instance: 820df13c-9f91-4a7a-a206-907e4f78817b] Received unexpected event network-vif-plugged-fccdef99-6171-4f48-8296-4e814cf583bb for instance with vm_state deleted and task_state None.
Nov 22 16:05:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:27 user nova-compute[75734]: INFO nova.compute.manager [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Unrescuing
Nov 22 16:05:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:05:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquired lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:05:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:05:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:05:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Releasing lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:05:27 user nova-compute[75734]: DEBUG nova.objects.instance [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'flavor' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:05:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-0eb5e669-ee15-4868-aaf1-d16e962913f9 req-b7468ff4-1568-4ec6-919e-405c0117154b service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0eb5e669-ee15-4868-aaf1-d16e962913f9 req-b7468ff4-1568-4ec6-919e-405c0117154b service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0eb5e669-ee15-4868-aaf1-d16e962913f9 req-b7468ff4-1568-4ec6-919e-405c0117154b service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0eb5e669-ee15-4868-aaf1-d16e962913f9 req-b7468ff4-1568-4ec6-919e-405c0117154b service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-0eb5e669-ee15-4868-aaf1-d16e962913f9 req-b7468ff4-1568-4ec6-919e-405c0117154b service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:28 user nova-compute[75734]: WARNING nova.compute.manager [req-0eb5e669-ee15-4868-aaf1-d16e962913f9 req-b7468ff4-1568-4ec6-919e-405c0117154b service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:05:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance destroyed successfully.
Nov 22 16:05:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:30 user nova-compute[75734]: WARNING nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:05:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:30 user nova-compute[75734]: WARNING nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:05:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:30 user nova-compute[75734]: WARNING nova.compute.manager [req-a519e0a4-6715-4c0b-80a4-ba4bd1b06e63 req-bd03984b-a42e-41e0-90ba-2f2c42adaac2 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:05:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7113cf91-8424-4d15-8e78-7d45084fbe97 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:05:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-changed-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Refreshing instance network info cache due to event network-changed-4d1268d1-c615-41a0-9db7-7eec1b68a27d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:05:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] Acquiring lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:05:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] Acquired lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:05:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Refreshing network info cache for port 4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:05:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updated VIF entry in instance network info cache for port 4d1268d1-c615-41a0-9db7-7eec1b68a27d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:05:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating instance_info_cache with network_info: [{"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:05:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8fcb5a9f-cc4a-4310-baf0-0130c805628d req-e3938025-1ec9-46b6-a00e-345b0178a6a8 service nova] Releasing lock "refresh_cache-90daf829-e4b2-4f46-a915-d2374bb0896c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:05:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:41 user nova-compute[75734]: INFO nova.compute.manager [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attaching volume 93409403-fc6b-4ac4-bc46-b3816daff5c9 to /dev/vdb
Nov 22 16:05:41 user nova-compute[75734]: DEBUG os_brick.utils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6981dfc-c17b-442e-9420-7b85617835e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e34a2-267d-4897-aeaf-eee0d1b7505e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f97976b-1262-43a6-9e90-a7cb2ffffd23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fe5586-e7d6-4730-8625-d4de1ffb27d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:05:41 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:05:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[635e435b-646a-4545-96d4-4919ab8cfb3a]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG os_brick.utils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:05:41 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating existing volume attachment record: d9c8410e-da1d-48e5-aaf5-46c6a457e10e {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:05:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:46 user nova-compute[75734]: INFO nova.compute.manager [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Terminating instance
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-0688c92e-8ae7-4301-a0e1-f0676099bba2 req-d698e0bd-c969-45b2-a156-396b3b2c5c53 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-vif-unplugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0688c92e-8ae7-4301-a0e1-f0676099bba2 req-d698e0bd-c969-45b2-a156-396b3b2c5c53 service nova] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0688c92e-8ae7-4301-a0e1-f0676099bba2 req-d698e0bd-c969-45b2-a156-396b3b2c5c53 service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0688c92e-8ae7-4301-a0e1-f0676099bba2 req-d698e0bd-c969-45b2-a156-396b3b2c5c53 service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-0688c92e-8ae7-4301-a0e1-f0676099bba2 req-d698e0bd-c969-45b2-a156-396b3b2c5c53 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] No waiting events found dispatching network-vif-unplugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-0688c92e-8ae7-4301-a0e1-f0676099bba2 req-d698e0bd-c969-45b2-a156-396b3b2c5c53 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-vif-unplugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Instance destroyed successfully.
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'resources' on Instance uuid a9bd2406-f5bb-4f1e-bae4-c0654554ac88 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888204927',display_name='tempest-AttachVolumeNegativeTest-server-1888204927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888204927',id=18,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN34Qi0266VZuWHwUq7fIUKrV8XrCFkv9a/ZluV/ME5zQCPPIW3LWG2JeAzuWTmlrHYVXskNOieqKXvLHkah8vEEa+6Sd+ldJIwP4wRpoDb/nVMn0sfjR+8QY8ewDUoGA==',key_name='tempest-keypair-1503422929',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-e1ej7ogd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=a9bd2406-f5bb-4f1e-bae4-c0654554ac88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "address": "fa:16:3e:da:48:86", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2cc3c5-35", "ovs_interfaceid": "1c2cc3c5-35f5-42ce-9652-a202016bd053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:48:86,bridge_name='br-int',has_traffic_filtering=True,id=1c2cc3c5-35f5-42ce-9652-a202016bd053,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2cc3c5-35') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG os_vif [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:48:86,bridge_name='br-int',has_traffic_filtering=True,id=1c2cc3c5-35f5-42ce-9652-a202016bd053,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2cc3c5-35') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c2cc3c5-35, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6975589e-7956-48b4-8f66-1857ad3d7d43) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:46 user nova-compute[75734]: INFO os_vif [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:48:86,bridge_name='br-int',has_traffic_filtering=True,id=1c2cc3c5-35f5-42ce-9652-a202016bd053,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2cc3c5-35')
Nov 22 16:05:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Deleting instance files /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88_del
Nov 22 16:05:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Deletion of /opt/stack/data/nova/instances/a9bd2406-f5bb-4f1e-bae4-c0654554ac88_del complete
Nov 22 16:05:46 user nova-compute[75734]: INFO nova.compute.manager [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 22 16:05:46 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:05:46 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:05:47 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:05:47 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Took 0.74 seconds to deallocate network for instance.
Nov 22 16:05:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-75228653-695b-4bf6-aa14-7f77b686377c req-b161af0c-c3f6-4c7d-bac7-21da5a04810a service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-vif-deleted-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxpzDSQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:05:48 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:05:48 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:05:48 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705cacd-23e4-4810-a53c-8bd1fd66250f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:05:48 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3d9aee-400a-4ec5-b59b-3650993121be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9] added
Nov 22 16:05:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ed0a1-b246-49ba-ac05-6a4a176ff70c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31841f9d-0426-4db0-8b27-54d2569ff736]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxpzDSQy {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Deleted allocations for instance a9bd2406-f5bb-4f1e-bae4-c0654554ac88
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxpzDSQy" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b2e88-72a9-4a39-9e59-ed5f3382d615]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxpzDSQy'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13b069c-1cc8-4ffc-a19e-1c2b37758577]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb1183-8278-4fa1-a7d6-ef0102a66e02]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1be842e-a445-4875-bf8a-10c7484375a8 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f64d77-707c-4679-b362-ec6f4c435351]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260]
Nov 22 16:05:48 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260] successful.
Nov 22 16:05:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae352e-8281-4ec3-b840-43972eebad8e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8357c614-7b10-4939-93ab-201633cd2ae9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)
Nov 22 16:05:48 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ec2246-13b2-4536-99ba-e245c12bd7e1]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxpzDSQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-4973c136-6818-451d-b731-2262deda84c3 req-54087ec1-8946-4329-bf75-2aadb69ca1f8 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received event network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4973c136-6818-451d-b731-2262deda84c3 req-54087ec1-8946-4329-bf75-2aadb69ca1f8 service nova] Acquiring lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4973c136-6818-451d-b731-2262deda84c3 req-54087ec1-8946-4329-bf75-2aadb69ca1f8 service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4973c136-6818-451d-b731-2262deda84c3 req-54087ec1-8946-4329-bf75-2aadb69ca1f8 service nova] Lock "a9bd2406-f5bb-4f1e-bae4-c0654554ac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-4973c136-6818-451d-b731-2262deda84c3 req-54087ec1-8946-4329-bf75-2aadb69ca1f8 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] No waiting events found dispatching network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:48 user nova-compute[75734]: WARNING nova.compute.manager [req-4973c136-6818-451d-b731-2262deda84c3 req-54087ec1-8946-4329-bf75-2aadb69ca1f8 service nova] [instance: a9bd2406-f5bb-4f1e-bae4-c0654554ac88] Received unexpected event network-vif-plugged-1c2cc3c5-35f5-42ce-9652-a202016bd053 for instance with vm_state deleted and task_state None.
Nov 22 16:05:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:05:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23935653464306335', 'path': '/dev/sde'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:05:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935653464306335', 'path': '/dev/sde'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:05:49 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:05:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:05:49 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:05:49 user nova-compute[75734]:   <source dev="/dev/sde"/>
Nov 22 16:05:49 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:05:49 user nova-compute[75734]:   <serial>93409403-fc6b-4ac4-bc46-b3816daff5c9</serial>
Nov 22 16:05:49 user nova-compute[75734]: </disk>
Nov 22 16:05:49 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:05:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:05:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:05:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No VIF found with MAC fa:16:3e:de:13:28, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:05:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f812e4de-529e-439a-9df4-bb7bdd2ffa6d tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.562s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:51 user nova-compute[75734]: INFO nova.compute.manager [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Terminating instance
Nov 22 16:05:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-b3461bd1-6279-49f7-b435-42a0b8836155 req-c54c8760-8bc7-476d-b79f-4c018151a66b service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b3461bd1-6279-49f7-b435-42a0b8836155 req-c54c8760-8bc7-476d-b79f-4c018151a66b service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b3461bd1-6279-49f7-b435-42a0b8836155 req-c54c8760-8bc7-476d-b79f-4c018151a66b service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b3461bd1-6279-49f7-b435-42a0b8836155 req-c54c8760-8bc7-476d-b79f-4c018151a66b service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-b3461bd1-6279-49f7-b435-42a0b8836155 req-c54c8760-8bc7-476d-b79f-4c018151a66b service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-b3461bd1-6279-49f7-b435-42a0b8836155 req-c54c8760-8bc7-476d-b79f-4c018151a66b service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-unplugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Instance destroyed successfully.
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.objects.instance [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lazy-loading 'resources' on Instance uuid 5dbde2ab-53f7-46db-a454-bcc8980833dc {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-707148199',display_name='tempest-ServerActionsTestOtherB-server-707148199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-707148199',id=13,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAulMmsYbY+gA4CwhRD6Br+Lx7ktM6pWHCF6yIobJ9Mj/fE9qZfk1ydsfzwMjxyEx4EYWE8i2StHbwRXvJp+m2y5bfIUbPwC0DXNiz1CKRJcQM0dmS/ClbIa2HSkbqwFg==',key_name='tempest-keypair-420406083',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:03:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d179eb8ada444378bb4412630b6e12a',ramdisk_id='',reservation_id='r-ir6mhnk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1674044799',owner_user_name='tempest-ServerActionsTestOtherB-1674044799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b585828df0c4d2786a02ff5621a0732',uuid=5dbde2ab-53f7-46db-a454-bcc8980833dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converting VIF {"id": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "address": "fa:16:3e:26:22:8a", "network": {"id": "c2516d58-8a74-4381-af41-8685e53dc7da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025175957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d179eb8ada444378bb4412630b6e12a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6a34b-4d", "ovs_interfaceid": "15e6a34b-4d97-4ae0-849e-8f64c4043ddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_vif [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e6a34b-4d, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d4d5f51-2755-4554-bf97-f934a51734cc) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:52 user nova-compute[75734]: INFO os_vif [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=15e6a34b-4d97-4ae0-849e-8f64c4043ddd,network=Network(c2516d58-8a74-4381-af41-8685e53dc7da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6a34b-4d')
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxfresZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:05:52 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece4ff1-58e0-4f32-b81f-38f50aeaa7c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:05:52 user nova-compute[75734]: No targets found.
Nov 22 16:05:52 user nova-compute[75734]: iSNS:
Nov 22 16:05:52 user nova-compute[75734]: No targets found.
Nov 22 16:05:52 user nova-compute[75734]: STATIC:
Nov 22 16:05:52 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:05:52 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:52 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:52 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d
Nov 22 16:05:52 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:52 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:52 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:05:52 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:52 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:52 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:05:52 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:52 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:52 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9
Nov 22 16:05:52 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:52 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:52 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647
Nov 22 16:05:52 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:52 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:52 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:05:52 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:05:52 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:05:52 user nova-compute[75734]: FIRMWARE:
Nov 22 16:05:52 user nova-compute[75734]: No targets found.
Nov 22 16:05:52 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:05:52 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:05:52 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3915d4b8-15e1-4a3e-a851-436294c724f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f3334-bac0-4118-8176-64560a22ea6f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)
Nov 22 16:05:52 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac732e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb587f5-07b4-4c82-ba58-275ab6c845d8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5edc82-1da7-4aeb-a3d4-e40a71978a01]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e3448-2c0d-4cd0-bf44-967ed160a1b2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdbb6d9-2ba8-48aa-bacd-ca4ab797dae0]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b1549c-2544-488a-91c1-443a7b30f6c7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b3488-d0fa-466a-a462-928619e83c35]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260]
Nov 22 16:05:52 user nova-compute[75734]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d, portal: 172.16.0.220,3260] successful.
Nov 22 16:05:52 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a8acc4b-79f1-4119-a687-3c95bdd79e6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584af3d-5f38-43e6-8e08-c5e1acd5a57b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] <== disconnect_volume: return (356ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:05:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Deleting instance files /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc_del
Nov 22 16:05:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Deletion of /opt/stack/data/nova/instances/5dbde2ab-53f7-46db-a454-bcc8980833dc_del complete
Nov 22 16:05:52 user nova-compute[75734]: INFO nova.compute.manager [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 22 16:05:52 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:05:52 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:05:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:05:54 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Took 1.22 seconds to deallocate network for instance.
Nov 22 16:05:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-0245ea27-e047-4d5a-b35c-2e38d662ccc0 req-2b9686ee-4c43-4c04-a3ea-e35897e18cd6 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0245ea27-e047-4d5a-b35c-2e38d662ccc0 req-2b9686ee-4c43-4c04-a3ea-e35897e18cd6 service nova] Acquiring lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0245ea27-e047-4d5a-b35c-2e38d662ccc0 req-2b9686ee-4c43-4c04-a3ea-e35897e18cd6 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0245ea27-e047-4d5a-b35c-2e38d662ccc0 req-2b9686ee-4c43-4c04-a3ea-e35897e18cd6 service nova] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-0245ea27-e047-4d5a-b35c-2e38d662ccc0 req-2b9686ee-4c43-4c04-a3ea-e35897e18cd6 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] No waiting events found dispatching network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:05:54 user nova-compute[75734]: WARNING nova.compute.manager [req-0245ea27-e047-4d5a-b35c-2e38d662ccc0 req-2b9686ee-4c43-4c04-a3ea-e35897e18cd6 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received unexpected event network-vif-plugged-15e6a34b-4d97-4ae0-849e-8f64c4043ddd for instance with vm_state active and task_state deleting.
Nov 22 16:05:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-0245ea27-e047-4d5a-b35c-2e38d662ccc0 req-2b9686ee-4c43-4c04-a3ea-e35897e18cd6 service nova] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Received event network-vif-deleted-15e6a34b-4d97-4ae0-849e-8f64c4043ddd {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:54 user nova-compute[75734]: INFO nova.compute.manager [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] [instance: 5dbde2ab-53f7-46db-a454-bcc8980833dc] Took 0.82 seconds to detach 1 volumes for instance.
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:55 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Deleted allocations for instance 5dbde2ab-53f7-46db-a454-bcc8980833dc
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aa93c639-07cc-4502-9260-74cbc5eb0c95 tempest-ServerActionsTestOtherB-1674044799 tempest-ServerActionsTestOtherB-1674044799-project-member] Lock "5dbde2ab-53f7-46db-a454-bcc8980833dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.005s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:05:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:05:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:05:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:05:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7572MB free_disk=24.97905731201172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 452d0048-4b11-40f4-b004-d7ded6232e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 90daf829-e4b2-4f46-a915-d2374bb0896c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cee17c90-5f3f-4455-a696-4ba11cd02451 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance faaf4403-3509-4b15-af7b-37fefceafa90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:05:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:05:59 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:05:59 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:05:59 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:05:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [{"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-ee07b591-af40-4c95-9d6a-1ffc82eff086" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:06:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:06:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:03 user nova-compute[75734]: INFO nova.compute.manager [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Detaching volume 93409403-fc6b-4ac4-bc46-b3816daff5c9
Nov 22 16:06:03 user nova-compute[75734]: INFO nova.virt.block_device [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attempting to driver detach volume 93409403-fc6b-4ac4-bc46-b3816daff5c9 from mountpoint /dev/vdb
Nov 22 16:06:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Attempting to detach device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:06:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:06:03 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:06:03 user nova-compute[75734]:   <source dev="/dev/sde"/>
Nov 22 16:06:03 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:06:03 user nova-compute[75734]:   <serial>93409403-fc6b-4ac4-bc46-b3816daff5c9</serial>
Nov 22 16:06:03 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:06:03 user nova-compute[75734]: </disk>
Nov 22 16:06:03 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:06:03 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config.
Nov 22 16:06:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:06:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:06:03 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:06:03 user nova-compute[75734]:   <source dev="/dev/sde"/>
Nov 22 16:06:03 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:06:03 user nova-compute[75734]:   <serial>93409403-fc6b-4ac4-bc46-b3816daff5c9</serial>
Nov 22 16:06:03 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:06:03 user nova-compute[75734]: </disk>
Nov 22 16:06:03 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:06:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:06:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:23 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c is timed out.
Nov 22 16:06:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config.
Nov 22 16:06:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxpzDSQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:06:23 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:06:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f421f-8c2e-443a-8018-04cfbe1618bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:06:23 user nova-compute[75734]: No targets found.
Nov 22 16:06:23 user nova-compute[75734]: iSNS:
Nov 22 16:06:23 user nova-compute[75734]: No targets found.
Nov 22 16:06:23 user nova-compute[75734]: STATIC:
Nov 22 16:06:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:06:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:06:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:06:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9
Nov 22 16:06:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647
Nov 22 16:06:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:23 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:06:23 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:23 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:23 user nova-compute[75734]: FIRMWARE:
Nov 22 16:06:23 user nova-compute[75734]: No targets found.
Nov 22 16:06:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:06:23 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:06:23 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:06:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d060dc-d48c-41a0-b4d7-a7799820cd6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4085e1a-3853-4c00-847c-30aef40e850d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 (non-flash)
Nov 22 16:06:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac790d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9'): ({'sde'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Removing single pathed devices sde {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4ddef6-84bb-4666-b135-a91529f63092]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[537e13fd-1e1b-4332-a5ab-d59f59386867]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Flushing IO for device /dev/sde {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c042785c-fe29-4258-892a-aa906554ae65]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e200da0c-fcee-41cc-8468-edca656eccdd]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999b36d-8ca8-4282-a93a-3792a22e2747]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b46371f-5486-48c1-9652-44b5a04553e0]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260]
Nov 22 16:06:24 user nova-compute[75734]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9, portal: 172.16.0.220,3260] successful.
Nov 22 16:06:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93409403-fc6b-4ac4-bc46-b3816daff5c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfbac67-68bb-4d8a-bb0f-545763370285]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== disconnect_volume: return (318ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:06:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:06:25 user nova-compute[75734]: DEBUG nova.objects.instance [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-23f574b4-75bb-467b-b439-ac5be3c95120 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:27 user nova-compute[75734]: INFO nova.compute.manager [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Rescuing
Nov 22 16:06:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:06:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:06:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:06:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updating instance_info_cache with network_info: [{"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:06:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-60b52167-ced3-4a94-9e0d-9d22e09eae38 req-9ea04f99-013a-4863-9209-6aa1197a232c service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-60b52167-ced3-4a94-9e0d-9d22e09eae38 req-9ea04f99-013a-4863-9209-6aa1197a232c service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-60b52167-ced3-4a94-9e0d-9d22e09eae38 req-9ea04f99-013a-4863-9209-6aa1197a232c service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-60b52167-ced3-4a94-9e0d-9d22e09eae38 req-9ea04f99-013a-4863-9209-6aa1197a232c service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-60b52167-ced3-4a94-9e0d-9d22e09eae38 req-9ea04f99-013a-4863-9209-6aa1197a232c service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:06:28 user nova-compute[75734]: WARNING nova.compute.manager [req-60b52167-ced3-4a94-9e0d-9d22e09eae38 req-9ea04f99-013a-4863-9209-6aa1197a232c service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state active and task_state rescuing.
Nov 22 16:06:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance destroyed successfully.
Nov 22 16:06:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Attempting a stable device rescue
Nov 22 16:06:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75734) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 16:06:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Creating image(s)
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "/opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "/opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG nova.objects.instance [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'trusted_certs' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "62190d142a58c6ef50ee26a7d8f1537cbcd87656" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "62190d142a58c6ef50ee26a7d8f1537cbcd87656" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG nova.virt.images [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] 708d9e04-81c3-4b3f-aaee-7d561b2a79d4 was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.part /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-7de3cdd8-d7b8-4793-bbe4-a538815305d9 req-cf8e6db7-301a-44ad-9464-3ddb3c8f9205 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7de3cdd8-d7b8-4793-bbe4-a538815305d9 req-cf8e6db7-301a-44ad-9464-3ddb3c8f9205 service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7de3cdd8-d7b8-4793-bbe4-a538815305d9 req-cf8e6db7-301a-44ad-9464-3ddb3c8f9205 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7de3cdd8-d7b8-4793-bbe4-a538815305d9 req-cf8e6db7-301a-44ad-9464-3ddb3c8f9205 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-7de3cdd8-d7b8-4793-bbe4-a538815305d9 req-cf8e6db7-301a-44ad-9464-3ddb3c8f9205 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:06:30 user nova-compute[75734]: WARNING nova.compute.manager [req-7de3cdd8-d7b8-4793-bbe4-a538815305d9 req-cf8e6db7-301a-44ad-9464-3ddb3c8f9205 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state active and task_state rescuing.
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.part /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.converted" returned: 0 in 0.613s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "62190d142a58c6ef50ee26a7d8f1537cbcd87656" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.153s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "62190d142a58c6ef50ee26a7d8f1537cbcd87656" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "62190d142a58c6ef50ee26a7d8f1537cbcd87656" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656 --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656,backing_fmt=raw /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656,backing_fmt=raw /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue" returned: 0 in 0.060s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "62190d142a58c6ef50ee26a7d8f1537cbcd87656" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.instance [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'migration_context' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<cee17c90-5f3f-4455-a696-4ba11cd02451> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Start _get_guest_xml network_info=[{"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "vif_mac": "fa:16:3e:30:46:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '708d9e04-81c3-4b3f-aaee-7d561b2a79d4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '09ac064b-1308-4c8e-b5fc-ebd6ae630a13', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdbGXOfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'cee17c90-5f3f-4455-a696-4ba11cd02451', 'attached_at': '', 'detached_at': '', 'volume_id': '3b4a34a8-c78f-4372-9828-4f707d420f99', 'serial': '3b4a34a8-c78f-4372-9828-4f707d420f99'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.instance [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'resources' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<cee17c90-5f3f-4455-a696-4ba11cd02451> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.instance [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'numa_topology' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<cee17c90-5f3f-4455-a696-4ba11cd02451> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:06:31 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:06:31 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.instance [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'vcpu_model' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<cee17c90-5f3f-4455-a696-4ba11cd02451> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdbGXOfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:06:31 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:06:31 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:06:31 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e14dde-5c67-4388-a65e-c1f65bb39300]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VdbGXOfh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 16:06:31 user nova-compute[75734]: node.name = iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:06:31 user nova-compute[75734]: node.tpgt = -1
Nov 22 16:06:31 user nova-compute[75734]: node.startup = automatic
Nov 22 16:06:31 user nova-compute[75734]: node.leading_login = No
Nov 22 16:06:31 user nova-compute[75734]: iface.iscsi_ifacename = default
Nov 22 16:06:31 user nova-compute[75734]: iface.net_ifacename = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.ipaddress = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.prefix_len = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.hwaddress = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.transport_name = tcp
Nov 22 16:06:31 user nova-compute[75734]: iface.initiatorname = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.state = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.vlan_id = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.vlan_priority = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.vlan_state = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.iface_num = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.mtu = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.port = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.bootproto = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.subnet_mask = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.gateway = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_alt_client_id = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_dns = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_learn_iqn = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_vendor_id_state = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_vendor_id = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.dhcp_slp_da = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.fragmentation = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.gratuitous_arp = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.incoming_forwarding = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.tos_state = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.tos = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.ttl = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.delayed_ack = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.tcp_nagle = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.tcp_wsf_state = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.tcp_wsf = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.tcp_timer_scale = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.tcp_timestamp = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.redirect = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.def_task_mgmt_timeout = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.header_digest = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.data_digest = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.immediate_data = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.initial_r2t = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.data_seq_inorder = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.data_pdu_inorder = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.erl = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.max_receive_data_len = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.first_burst_len = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.max_outstanding_r2t = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.max_burst_len = 0
Nov 22 16:06:31 user nova-compute[75734]: iface.chap_auth = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.bidi_chap = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.strict_login_compliance = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.discovery_auth = <empty>
Nov 22 16:06:31 user nova-compute[75734]: iface.discovery_logout = <empty>
Nov 22 16:06:31 user nova-compute[75734]: node.discovery_address = <empty>
Nov 22 16:06:31 user nova-compute[75734]: node.discovery_port = 0
Nov 22 16:06:31 user nova-compute[75734]: node.discovery_type = static
Nov 22 16:06:31 user nova-compute[75734]: node.session.initial_cmdsn = 0
Nov 22 16:06:31 user nova-compute[75734]: node.session.initial_login_retry_max = 8
Nov 22 16:06:31 user nova-compute[75734]: node.session.xmit_thread_priority = -20
Nov 22 16:06:31 user nova-compute[75734]: node.session.cmds_max = 128
Nov 22 16:06:31 user nova-compute[75734]: node.session.queue_depth = 32
Nov 22 16:06:31 user nova-compute[75734]: node.session.nr_sessions = 1
Nov 22 16:06:31 user nova-compute[75734]: node.session.auth.authmethod = CHAP
Nov 22 16:06:31 user nova-compute[75734]: node.session.auth.username = VdbGXOfh
Nov 22 16:06:31 user nova-compute[75734]: node.session.auth.password = ***
Nov 22 16:06:31 user nova-compute[75734]: node.session.auth.username_in = <empty>
Nov 22 16:06:31 user nova-compute[75734]: node.session.auth.password_in = <empty>
Nov 22 16:06:31 user nova-compute[75734]: node.session.auth.chap_algs = MD5
Nov 22 16:06:31 user nova-compute[75734]: node.session.timeo.replacement_timeout = 120
Nov 22 16:06:31 user nova-compute[75734]: node.session.err_timeo.abort_timeout = 15
Nov 22 16:06:31 user nova-compute[75734]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 16:06:31 user nova-compute[75734]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 16:06:31 user nova-compute[75734]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.FastAbort = Yes
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.InitialR2T = No
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.ImmediateData = Yes
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.MaxConnections = 1
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 16:06:31 user nova-compute[75734]: node.session.iscsi.ERL = 0
Nov 22 16:06:31 user nova-compute[75734]: node.session.scan = manual
Nov 22 16:06:31 user nova-compute[75734]: node.session.reopen_max = 0
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].address = 172.16.0.220
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].port = 3260
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].startup = manual
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].tcp.window_size = 524288
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].tcp.type_of_service = 0
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].timeo.logout_timeout = 15
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].timeo.login_timeout = 15
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].timeo.auth_timeout = 45
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].iscsi.DataDigest = None
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].iscsi.IFMarker = No
Nov 22 16:06:31 user nova-compute[75734]: node.conn[0].iscsi.OFMarker = No
Nov 22 16:06:31 user nova-compute[75734]: # END RECORD
Nov 22 16:06:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf83bd-5c96-4697-a11b-eb762316880c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f52d8f-b936-44ac-a06c-da0154e1cc50]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdbGXOfh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdbGXOfh" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b1691-b4d8-447b-8dd8-1a9f542ef1d4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdbGXOfh'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4b0ef-7f4e-492a-a441-156efc12abc2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fde285-81dc-4ce3-b012-998dd43a42af]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:06:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:31 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:06:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] HCTL ('39', '0', '0', 0) found on session 30 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7ae019-8f4d-4816-a718-fb266cb44b98]: (4, ('0 0 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Searching for a device in session 30 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdbGXOfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '26562343933306532', 'path': '/dev/sdh'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562343933306532', 'path': '/dev/sdh'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-152740879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-152740879',id=25,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:04:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-bxm0e8ww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:04:55Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=cee17c90-5f3f-4455-a696-4ba11cd02451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "vif_mac": "fa:16:3e:30:46:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "vif_mac": "fa:16:3e:30:46:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.instance [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'pci_devices' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.objects.base [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Object Instance<cee17c90-5f3f-4455-a696-4ba11cd02451> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:06:31 user nova-compute[75734]:   <uuid>cee17c90-5f3f-4455-a696-4ba11cd02451</uuid>
Nov 22 16:06:31 user nova-compute[75734]:   <name>instance-00000019</name>
Nov 22 16:06:31 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:06:31 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:06:31 user nova-compute[75734]:   <metadata>
Nov 22 16:06:31 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:06:31 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:06:31 user nova-compute[75734]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-152740879</nova:name>
Nov 22 16:06:31 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:06:31</nova:creationTime>
Nov 22 16:06:31 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:06:31 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:06:31 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:06:31 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:06:31 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:06:31 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:06:31 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:06:31 user nova-compute[75734]:       <nova:owner>
Nov 22 16:06:31 user nova-compute[75734]:         <nova:user uuid="5dc99ff4c7054545a10673afb2cf930b">tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member</nova:user>
Nov 22 16:06:31 user nova-compute[75734]:         <nova:project uuid="234cf12714b74b12aa027c8fff2e784e">tempest-ServerBootFromVolumeStableRescueTest-1333150873</nova:project>
Nov 22 16:06:31 user nova-compute[75734]:       </nova:owner>
Nov 22 16:06:31 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:06:31 user nova-compute[75734]:       <nova:ports>
Nov 22 16:06:31 user nova-compute[75734]:         <nova:port uuid="66f1f97a-8d33-486b-86ec-59754c68b651">
Nov 22 16:06:31 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 16:06:31 user nova-compute[75734]:         </nova:port>
Nov 22 16:06:31 user nova-compute[75734]:       </nova:ports>
Nov 22 16:06:31 user nova-compute[75734]:     </nova:instance>
Nov 22 16:06:31 user nova-compute[75734]:   </metadata>
Nov 22 16:06:31 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:06:31 user nova-compute[75734]:     <system>
Nov 22 16:06:31 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:06:31 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:06:31 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:06:31 user nova-compute[75734]:       <entry name="serial">cee17c90-5f3f-4455-a696-4ba11cd02451</entry>
Nov 22 16:06:31 user nova-compute[75734]:       <entry name="uuid">cee17c90-5f3f-4455-a696-4ba11cd02451</entry>
Nov 22 16:06:31 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:06:31 user nova-compute[75734]:     </system>
Nov 22 16:06:31 user nova-compute[75734]:   </sysinfo>
Nov 22 16:06:31 user nova-compute[75734]:   <os>
Nov 22 16:06:31 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:06:31 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:06:31 user nova-compute[75734]:   </os>
Nov 22 16:06:31 user nova-compute[75734]:   <features>
Nov 22 16:06:31 user nova-compute[75734]:     <acpi/>
Nov 22 16:06:31 user nova-compute[75734]:     <apic/>
Nov 22 16:06:31 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:06:31 user nova-compute[75734]:   </features>
Nov 22 16:06:31 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:06:31 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:06:31 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:06:31 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:06:31 user nova-compute[75734]:   </clock>
Nov 22 16:06:31 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:06:31 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:06:31 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:06:31 user nova-compute[75734]:   </cpu>
Nov 22 16:06:31 user nova-compute[75734]:   <devices>
Nov 22 16:06:31 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:06:31 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:06:31 user nova-compute[75734]:       <source dev="/dev/sdh"/>
Nov 22 16:06:31 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:06:31 user nova-compute[75734]:       <serial>3b4a34a8-c78f-4372-9828-4f707d420f99</serial>
Nov 22 16:06:31 user nova-compute[75734]:     </disk>
Nov 22 16:06:31 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:06:31 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:06:31 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue"/>
Nov 22 16:06:31 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:06:31 user nova-compute[75734]:       <boot order="1"/>
Nov 22 16:06:31 user nova-compute[75734]:     </disk>
Nov 22 16:06:31 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:06:31 user nova-compute[75734]:       <mac address="fa:16:3e:30:46:d0"/>
Nov 22 16:06:31 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:06:31 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:06:31 user nova-compute[75734]:       <target dev="tap66f1f97a-8d"/>
Nov 22 16:06:31 user nova-compute[75734]:     </interface>
Nov 22 16:06:31 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:06:31 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/console.log" append="off"/>
Nov 22 16:06:31 user nova-compute[75734]:     </serial>
Nov 22 16:06:31 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:06:31 user nova-compute[75734]:     <video>
Nov 22 16:06:31 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:06:31 user nova-compute[75734]:     </video>
Nov 22 16:06:31 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:06:31 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:06:31 user nova-compute[75734]:     </rng>
Nov 22 16:06:31 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:06:31 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:06:31 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:06:31 user nova-compute[75734]:     </memballoon>
Nov 22 16:06:31 user nova-compute[75734]:   </devices>
Nov 22 16:06:31 user nova-compute[75734]: </domain>
Nov 22 16:06:31 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:06:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance destroyed successfully.
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:06:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] No VIF found with MAC fa:16:3e:30:46:d0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:06:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-201ce29c-da72-48ea-adf5-ed6a1790f321 req-cf4388a7-66cf-4a62-b7c5-5e79e2eb60ab service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-201ce29c-da72-48ea-adf5-ed6a1790f321 req-cf4388a7-66cf-4a62-b7c5-5e79e2eb60ab service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-201ce29c-da72-48ea-adf5-ed6a1790f321 req-cf4388a7-66cf-4a62-b7c5-5e79e2eb60ab service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-201ce29c-da72-48ea-adf5-ed6a1790f321 req-cf4388a7-66cf-4a62-b7c5-5e79e2eb60ab service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-201ce29c-da72-48ea-adf5-ed6a1790f321 req-cf4388a7-66cf-4a62-b7c5-5e79e2eb60ab service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:06:33 user nova-compute[75734]: WARNING nova.compute.manager [req-201ce29c-da72-48ea-adf5-ed6a1790f321 req-cf4388a7-66cf-4a62-b7c5-5e79e2eb60ab service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state active and task_state rescuing.
Nov 22 16:06:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-370d39d0-88ef-490d-99fa-63a3ca01d2ea tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:06:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-730fdd1f-6976-4e60-87ab-6f7b37eb40fc req-64a2c483-8f88-485f-8e97-e7e0676ee4b1 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-730fdd1f-6976-4e60-87ab-6f7b37eb40fc req-64a2c483-8f88-485f-8e97-e7e0676ee4b1 service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-730fdd1f-6976-4e60-87ab-6f7b37eb40fc req-64a2c483-8f88-485f-8e97-e7e0676ee4b1 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-730fdd1f-6976-4e60-87ab-6f7b37eb40fc req-64a2c483-8f88-485f-8e97-e7e0676ee4b1 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-730fdd1f-6976-4e60-87ab-6f7b37eb40fc req-64a2c483-8f88-485f-8e97-e7e0676ee4b1 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:06:35 user nova-compute[75734]: WARNING nova.compute.manager [req-730fdd1f-6976-4e60-87ab-6f7b37eb40fc req-64a2c483-8f88-485f-8e97-e7e0676ee4b1 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state active and task_state rescuing.
Nov 22 16:06:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:39 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:06:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:06:39 user nova-compute[75734]: INFO nova.compute.claims [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Claim successful on node user
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event network-changed-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Refreshing instance network info cache due to event network-changed-b9eb5093-2818-45ae-ba0d-29ef0405420e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] Acquiring lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] Acquired lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.network.neutron [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Refreshing network info cache for port b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:06:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.policy [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb5b3c03bbb490f9ef6f3f9c70bf9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7d5b5135ca46c2a649df3c1ce2ac64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:06:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Creating image(s)
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "/opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG nova.network.neutron [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updated VIF entry in instance network info cache for port b9eb5093-2818-45ae-ba0d-29ef0405420e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG nova.network.neutron [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updating instance_info_cache with network_info: [{"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3804266a-8d71-464f-866d-a8ffa2a07f57 req-3882656b-7faf-47b6-90f3-84822e605bb9 service nova] Releasing lock "refresh_cache-faaf4403-3509-4b15-af7b-37fefceafa90" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk 1073741824" returned: 0 in 0.054s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Cannot resize image /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Ensure instance console log exists: /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:41 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Successfully created port: ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:06:42 user nova-compute[75734]: INFO nova.compute.manager [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Rebuilding instance
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-455bb5d9-a71c-4713-a8cc-692e66f55a26 req-848be080-ac26-4bd3-9f9d-bda7fdd3dd9a service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event network-vif-unplugged-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-455bb5d9-a71c-4713-a8cc-692e66f55a26 req-848be080-ac26-4bd3-9f9d-bda7fdd3dd9a service nova] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-455bb5d9-a71c-4713-a8cc-692e66f55a26 req-848be080-ac26-4bd3-9f9d-bda7fdd3dd9a service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-455bb5d9-a71c-4713-a8cc-692e66f55a26 req-848be080-ac26-4bd3-9f9d-bda7fdd3dd9a service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-455bb5d9-a71c-4713-a8cc-692e66f55a26 req-848be080-ac26-4bd3-9f9d-bda7fdd3dd9a service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] No waiting events found dispatching network-vif-unplugged-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:06:42 user nova-compute[75734]: WARNING nova.compute.manager [req-455bb5d9-a71c-4713-a8cc-692e66f55a26 req-848be080-ac26-4bd3-9f9d-bda7fdd3dd9a service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received unexpected event network-vif-unplugged-b9eb5093-2818-45ae-ba0d-29ef0405420e for instance with vm_state active and task_state rebuilding.
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Successfully updated port: ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquired lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:06:42 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance destroyed successfully.
Nov 22 16:06:42 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance destroyed successfully.
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1830407483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-368242086',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1lFGCe2iwvxzcqx/e0m218xdfEp4o6zmPD135gbBimZfV3uea5k9we8/wkfVlBFFAXo5oOOEZdO+JYh7H8YExi8cSWlkVPmnJYwesCHup3pLg3ssqFQsdmV/JYQXT84Q==',key_name='tempest-keypair-378398179',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1907da4ebb34a77ab650d943f728f98',ramdisk_id='',reservation_id='r-vyfkrzww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1321099151',owner_user_name='tempest-ServerActionsV293TestJSON-1321099151-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e6a31c87c74976b0d7aae6280cfd25',uuid=faaf4403-3509-4b15-af7b-37fefceafa90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converting VIF {"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG os_vif [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9eb5093-28, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=457ea5f9-3e5c-4905-a07f-e05ba8da1a07) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:42 user nova-compute[75734]: INFO os_vif [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28')
Nov 22 16:06:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhvLNPdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:06:43 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa514b-0fcf-4be9-995e-b5e365c0b024]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:06:43 user nova-compute[75734]: No targets found.
Nov 22 16:06:43 user nova-compute[75734]: iSNS:
Nov 22 16:06:43 user nova-compute[75734]: No targets found.
Nov 22 16:06:43 user nova-compute[75734]: STATIC:
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: FIRMWARE:
Nov 22 16:06:43 user nova-compute[75734]: No targets found.
Nov 22 16:06:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:06:43 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:06:43 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c948fb36-5ae0-4c2a-b738-2a190bf2f1cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[86954e49-c8fb-4dd6-bff8-6d4365473f88]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc321630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adbbb41-b19a-473c-9e3d-11ad05eac136]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe7df7-1268-40b3-bee6-ad6b8a32bab9]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103b567-c9b3-4dc5-98ef-2323332fcb49]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Updating instance_info_cache with network_info: [{"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Releasing lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Instance network_info: |[{"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Start _get_guest_xml network_info=[{"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:06:43 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:06:43 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1e4466-460f-4147-a96a-1d753cb0ed02]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26430393533323036', '/dev/disk/by-id/scsi-1SCST_BIO33bf6ea1-d0953206f07460ac', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_33bf6ea1') {{(pid=86452) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e58ac6-1f72-434e-ac1f-a695c84ae48e]: (4, None) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1382496233',display_name='tempest-AttachVolumeNegativeTest-server-1382496233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1382496233',id=27,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76ypbUpec2EfCce4ils9/NHOqCW/MkHkdmDtgYETjmO/iVIGMUhgwER3tVyMhn3OMcN2V9aoIPrwbn38p4uWE0tL+lGhTpKKm09fVhwjsC1f7GuVw++GrOjN8OEGHIKA==',key_name='tempest-keypair-1706036565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-xqsck0bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=044c6387-321b-4616-82ef-d917efb9eaf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8b:6e,bridge_name='br-int',has_traffic_filtering=True,id=ef4b670c-25a7-4174-b033-1501fea5852d,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4b670c-25') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.objects.instance [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'pci_devices' on Instance uuid 044c6387-321b-4616-82ef-d917efb9eaf2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dbf614-d9a2-42df-a099-237a6962eaa6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:06:43 user nova-compute[75734]:   <uuid>044c6387-321b-4616-82ef-d917efb9eaf2</uuid>
Nov 22 16:06:43 user nova-compute[75734]:   <name>instance-0000001b</name>
Nov 22 16:06:43 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:06:43 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:06:43 user nova-compute[75734]:   <metadata>
Nov 22 16:06:43 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:06:43 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:06:43 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1382496233</nova:name>
Nov 22 16:06:43 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:06:43</nova:creationTime>
Nov 22 16:06:43 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:06:43 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:06:43 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:06:43 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:06:43 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:06:43 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:06:43 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:06:43 user nova-compute[75734]:       <nova:owner>
Nov 22 16:06:43 user nova-compute[75734]:         <nova:user uuid="abb5b3c03bbb490f9ef6f3f9c70bf9d2">tempest-AttachVolumeNegativeTest-2104845353-project-member</nova:user>
Nov 22 16:06:43 user nova-compute[75734]:         <nova:project uuid="cb7d5b5135ca46c2a649df3c1ce2ac64">tempest-AttachVolumeNegativeTest-2104845353</nova:project>
Nov 22 16:06:43 user nova-compute[75734]:       </nova:owner>
Nov 22 16:06:43 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:06:43 user nova-compute[75734]:       <nova:ports>
Nov 22 16:06:43 user nova-compute[75734]:         <nova:port uuid="ef4b670c-25a7-4174-b033-1501fea5852d">
Nov 22 16:06:43 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 16:06:43 user nova-compute[75734]:         </nova:port>
Nov 22 16:06:43 user nova-compute[75734]:       </nova:ports>
Nov 22 16:06:43 user nova-compute[75734]:     </nova:instance>
Nov 22 16:06:43 user nova-compute[75734]:   </metadata>
Nov 22 16:06:43 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:06:43 user nova-compute[75734]:     <system>
Nov 22 16:06:43 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:06:43 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:06:43 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:06:43 user nova-compute[75734]:       <entry name="serial">044c6387-321b-4616-82ef-d917efb9eaf2</entry>
Nov 22 16:06:43 user nova-compute[75734]:       <entry name="uuid">044c6387-321b-4616-82ef-d917efb9eaf2</entry>
Nov 22 16:06:43 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:06:43 user nova-compute[75734]:     </system>
Nov 22 16:06:43 user nova-compute[75734]:   </sysinfo>
Nov 22 16:06:43 user nova-compute[75734]:   <os>
Nov 22 16:06:43 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:06:43 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:06:43 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:06:43 user nova-compute[75734]:   </os>
Nov 22 16:06:43 user nova-compute[75734]:   <features>
Nov 22 16:06:43 user nova-compute[75734]:     <acpi/>
Nov 22 16:06:43 user nova-compute[75734]:     <apic/>
Nov 22 16:06:43 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:06:43 user nova-compute[75734]:   </features>
Nov 22 16:06:43 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:06:43 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:06:43 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:06:43 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:06:43 user nova-compute[75734]:   </clock>
Nov 22 16:06:43 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:06:43 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:06:43 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:06:43 user nova-compute[75734]:   </cpu>
Nov 22 16:06:43 user nova-compute[75734]:   <devices>
Nov 22 16:06:43 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:06:43 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:06:43 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk"/>
Nov 22 16:06:43 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:06:43 user nova-compute[75734]:     </disk>
Nov 22 16:06:43 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:06:43 user nova-compute[75734]:       <mac address="fa:16:3e:fb:8b:6e"/>
Nov 22 16:06:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:06:43 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:06:43 user nova-compute[75734]:       <target dev="tapef4b670c-25"/>
Nov 22 16:06:43 user nova-compute[75734]:     </interface>
Nov 22 16:06:43 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:06:43 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/console.log" append="off"/>
Nov 22 16:06:43 user nova-compute[75734]:     </serial>
Nov 22 16:06:43 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:06:43 user nova-compute[75734]:     <video>
Nov 22 16:06:43 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:06:43 user nova-compute[75734]:     </video>
Nov 22 16:06:43 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:06:43 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:06:43 user nova-compute[75734]:     </rng>
Nov 22 16:06:43 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:06:43 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:06:43 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:06:43 user nova-compute[75734]:     </memballoon>
Nov 22 16:06:43 user nova-compute[75734]:   </devices>
Nov 22 16:06:43 user nova-compute[75734]: </domain>
Nov 22 16:06:43 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1382496233',display_name='tempest-AttachVolumeNegativeTest-server-1382496233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1382496233',id=27,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76ypbUpec2EfCce4ils9/NHOqCW/MkHkdmDtgYETjmO/iVIGMUhgwER3tVyMhn3OMcN2V9aoIPrwbn38p4uWE0tL+lGhTpKKm09fVhwjsC1f7GuVw++GrOjN8OEGHIKA==',key_name='tempest-keypair-1706036565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-xqsck0bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=044c6387-321b-4616-82ef-d917efb9eaf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8b:6e,bridge_name='br-int',has_traffic_filtering=True,id=ef4b670c-25a7-4174-b033-1501fea5852d,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4b670c-25') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_vif [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8b:6e,bridge_name='br-int',has_traffic_filtering=True,id=ef4b670c-25a7-4174-b033-1501fea5852d,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4b670c-25') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1680fb2-9315-5972-8bde-ce8757455f62', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef4b670c-25, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef4b670c-25, col_values=(('qos', UUID('03af87e0-bc2c-4ded-8da0-97a915381a2f')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef4b670c-25, col_values=(('external_ids', {'iface-id': 'ef4b670c-25a7-4174-b033-1501fea5852d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:8b:6e', 'vm-uuid': '044c6387-321b-4616-82ef-d917efb9eaf2'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:43 user nova-compute[75734]: INFO os_vif [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8b:6e,bridge_name='br-int',has_traffic_filtering=True,id=ef4b670c-25a7-4174-b033-1501fea5852d,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4b670c-25')
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ab473-81b3-4203-aea1-cb62925bf8e9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260]
Nov 22 16:06:43 user nova-compute[75734]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647, portal: 172.16.0.220,3260] successful.
Nov 22 16:06:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe91e8a-00d3-4582-a53f-9c15682fcf83]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] <== disconnect_volume: return (446ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:06:43 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Deleting instance files /opt/stack/data/nova/instances/faaf4403-3509-4b15-af7b-37fefceafa90_del
Nov 22 16:06:43 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Deletion of /opt/stack/data/nova/instances/faaf4403-3509-4b15-af7b-37fefceafa90_del complete
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No VIF found with MAC fa:16:3e:fb:8b:6e, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:06:43 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance faaf4403-3509-4b15-af7b-37fefceafa90 could not be found.
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhvLNPdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:06:43 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba208c-e7bc-4947-b207-4e9e897cabe6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:06:43 user nova-compute[75734]: No targets found.
Nov 22 16:06:43 user nova-compute[75734]: iSNS:
Nov 22 16:06:43 user nova-compute[75734]: No targets found.
Nov 22 16:06:43 user nova-compute[75734]: STATIC:
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:06:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:06:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:06:43 user nova-compute[75734]: FIRMWARE:
Nov 22 16:06:43 user nova-compute[75734]: No targets found.
Nov 22 16:06:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:06:43 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:06:43 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c39664-91bc-49b0-bd7c-c5dfe617527c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:43 user nova-compute[75734]: INFO nova.compute.manager [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Detaching volume e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d7fd3c-bb8f-4666-b119-48e24d0b5fb7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:06:43 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:06:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac78b910>, {}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Disconnecting from: [] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] <== disconnect_volume: return (92ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:06:43 user nova-compute[75734]: INFO nova.virt.block_device [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Attempting to driver detach volume e7178529-a0fe-4c6d-a6f5-ebb51c1428de from mountpoint /dev/vdb
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Attempting to detach device vdb from instance 452d0048-4b11-40f4-b004-d7ded6232e54 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:06:43 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:06:43 user nova-compute[75734]:   <source dev="/dev/sdg"/>
Nov 22 16:06:43 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:06:43 user nova-compute[75734]:   <serial>e7178529-a0fe-4c6d-a6f5-ebb51c1428de</serial>
Nov 22 16:06:43 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:06:43 user nova-compute[75734]: </disk>
Nov 22 16:06:43 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:06:43 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully detached device vdb from instance 452d0048-4b11-40f4-b004-d7ded6232e54 from the persistent domain config.
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 452d0048-4b11-40f4-b004-d7ded6232e54 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:06:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:06:43 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:06:43 user nova-compute[75734]:   <source dev="/dev/sdg"/>
Nov 22 16:06:43 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:06:43 user nova-compute[75734]:   <serial>e7178529-a0fe-4c6d-a6f5-ebb51c1428de</serial>
Nov 22 16:06:43 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:06:43 user nova-compute[75734]: </disk>
Nov 22 16:06:43 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 452d0048-4b11-40f4-b004-d7ded6232e54 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Preparing to wait for external event volume-reimaged-d6b8dab8-3e7c-4e0e-afee-a43c002be647 {{(pid=75734) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-changed-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Refreshing instance network info cache due to event network-changed-ef4b670c-25a7-4174-b033-1501fea5852d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] Acquiring lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] Acquired lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:06:44 user nova-compute[75734]: DEBUG nova.network.neutron [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Refreshing network info cache for port ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d46ed64-4d47-457f-aa6b-73c5c2ffdb16 req-ad3305c2-1c19-4767-a4ff-a513f741ba6f service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d46ed64-4d47-457f-aa6b-73c5c2ffdb16 req-ad3305c2-1c19-4767-a4ff-a513f741ba6f service nova] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d46ed64-4d47-457f-aa6b-73c5c2ffdb16 req-ad3305c2-1c19-4767-a4ff-a513f741ba6f service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8d46ed64-4d47-457f-aa6b-73c5c2ffdb16 req-ad3305c2-1c19-4767-a4ff-a513f741ba6f service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-8d46ed64-4d47-457f-aa6b-73c5c2ffdb16 req-ad3305c2-1c19-4767-a4ff-a513f741ba6f service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] No waiting events found dispatching network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:06:45 user nova-compute[75734]: WARNING nova.compute.manager [req-8d46ed64-4d47-457f-aa6b-73c5c2ffdb16 req-ad3305c2-1c19-4767-a4ff-a513f741ba6f service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received unexpected event network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d for instance with vm_state building and task_state spawning.
Nov 22 16:06:45 user nova-compute[75734]: DEBUG nova.network.neutron [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Updated VIF entry in instance network info cache for port ef4b670c-25a7-4174-b033-1501fea5852d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG nova.network.neutron [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Updating instance_info_cache with network_info: [{"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] Releasing lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] No event matching network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e in dict_keys([('volume-reimaged', 'd6b8dab8-3e7c-4e0e-afee-a43c002be647')]) {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 22 16:06:45 user nova-compute[75734]: WARNING nova.compute.manager [req-f567d0a6-9edf-40df-86e6-e1fd33e46b15 req-016ef049-af2d-4285-8c66-f2b0b51bf658 service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received unexpected event network-vif-plugged-b9eb5093-2818-45ae-ba0d-29ef0405420e for instance with vm_state active and task_state rebuilding.
Nov 22 16:06:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-e26097ad-179e-4446-900e-0984111c321a req-9370e6e7-aa05-4d03-9fde-c2f74903b8cb service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e26097ad-179e-4446-900e-0984111c321a req-9370e6e7-aa05-4d03-9fde-c2f74903b8cb service nova] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e26097ad-179e-4446-900e-0984111c321a req-9370e6e7-aa05-4d03-9fde-c2f74903b8cb service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e26097ad-179e-4446-900e-0984111c321a req-9370e6e7-aa05-4d03-9fde-c2f74903b8cb service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-e26097ad-179e-4446-900e-0984111c321a req-9370e6e7-aa05-4d03-9fde-c2f74903b8cb service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] No waiting events found dispatching network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:06:47 user nova-compute[75734]: WARNING nova.compute.manager [req-e26097ad-179e-4446-900e-0984111c321a req-9370e6e7-aa05-4d03-9fde-c2f74903b8cb service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received unexpected event network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d for instance with vm_state building and task_state spawning.
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:06:47 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Instance spawned successfully.
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:06:47 user nova-compute[75734]: INFO nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Took 7.02 seconds to spawn the instance on the hypervisor.
Nov 22 16:06:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:06:47 user nova-compute[75734]: INFO nova.compute.manager [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Took 7.94 seconds to build instance.
Nov 22 16:06:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6109a017-9f1e-437e-879d-08e5aeebe147 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.066s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:06:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:54 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG nova.objects.instance [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:06:56 user nova-compute[75734]: INFO nova.compute.manager [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attaching volume 4e52754c-b077-48f5-8c1d-030738a41863 to /dev/vdb
Nov 22 16:06:56 user nova-compute[75734]: DEBUG os_brick.utils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea145a0-8ae4-49f7-bef8-c69b99343cf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[97493641-ed0f-4815-ae18-fad766f6f4c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a06f68-69f4-4631-8764-28db175d3d8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da6eea6-50c2-4329-8720-0dc99f95afb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:06:57 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[328721cc-52a8-4383-9e35-e9449a9de44a]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG os_brick.utils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating existing volume attachment record: b85da29f-14aa-4e56-8282-953fc7691737 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:06:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:06:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:06:59 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7732MB free_disk=24.85818862915039GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:06:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 452d0048-4b11-40f4-b004-d7ded6232e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 90daf829-e4b2-4f46-a915-d2374bb0896c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cee17c90-5f3f-4455-a696-4ba11cd02451 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance faaf4403-3509-4b15-af7b-37fefceafa90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 044c6387-321b-4616-82ef-d917efb9eaf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:07:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:01 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:07:01 user nova-compute[75734]: INFO nova.compute.claims [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Claim successful on node user
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updating instance_info_cache with network_info: [{"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.878s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:07:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-e9133539-8921-4793-8f8c-5f06c5c725d7 req-a3f64dde-4cf0-4748-96f9-11f277bed5bb service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event volume-reimaged-d6b8dab8-3e7c-4e0e-afee-a43c002be647 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e9133539-8921-4793-8f8c-5f06c5c725d7 req-a3f64dde-4cf0-4748-96f9-11f277bed5bb service nova] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e9133539-8921-4793-8f8c-5f06c5c725d7 req-a3f64dde-4cf0-4748-96f9-11f277bed5bb service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e9133539-8921-4793-8f8c-5f06c5c725d7 req-a3f64dde-4cf0-4748-96f9-11f277bed5bb service nova] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-e9133539-8921-4793-8f8c-5f06c5c725d7 req-a3f64dde-4cf0-4748-96f9-11f277bed5bb service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Processing event volume-reimaged-d6b8dab8-3e7c-4e0e-afee-a43c002be647 {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:07:02 user nova-compute[75734]: DEBUG nova.policy [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c444f0bec7641458313d99ebcac79e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0470a32bf194b2ca5de3bd71af4409d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:07:03 user nova-compute[75734]: INFO nova.virt.block_device [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Booting with volume d6b8dab8-3e7c-4e0e-afee-a43c002be647 at /dev/vda
Nov 22 16:07:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:07:03 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Creating image(s)
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG os_brick.utils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead4c56-c5f0-4e9c-ba0b-1f6346e5e222]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f725bb2-b81d-43c5-8f60-609a3c647834]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[89469859-1f9c-4d6b-9ee6-4433e119ea6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[341deb9e-545f-4e3c-8814-d5bd6306b0bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.213s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:07:03 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[837eadc9-20fe-4c35-893e-0a0a7cd3bd35]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG os_brick.utils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] <== get_connector_properties: return (244ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updating existing volume attachment record: fb863d33-56d3-443b-b97c-0a0a641fc8a0 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.219s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk 1073741824" returned: 0 in 0.062s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Successfully created port: c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.252s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:07:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Cannot resize image /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Ensure instance console log exists: /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Successfully updated port: c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:07:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 452d0048-4b11-40f4-b004-d7ded6232e54 is timed out.
Nov 22 16:07:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully detached device vdb from instance 452d0048-4b11-40f4-b004-d7ded6232e54 from the live domain config.
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquired lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrlUGQcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:07:04 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing instance network info cache due to event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] Acquiring lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b79b30c-c486-45fd-bdd9-7963291078e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:07:04 user nova-compute[75734]: No targets found.
Nov 22 16:07:04 user nova-compute[75734]: iSNS:
Nov 22 16:07:04 user nova-compute[75734]: No targets found.
Nov 22 16:07:04 user nova-compute[75734]: STATIC:
Nov 22 16:07:04 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:07:04 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:04 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:04 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:07:04 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:04 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:04 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de
Nov 22 16:07:04 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:04 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:04 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:07:04 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:04 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:04 user nova-compute[75734]: FIRMWARE:
Nov 22 16:07:04 user nova-compute[75734]: No targets found.
Nov 22 16:07:04 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:07:04 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:07:04 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b7692f-4750-4bab-9a3a-d78b3aebe3e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebfedea-9ab5-4691-b4e8-e372ed1c7c63]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:04 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:04 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:07:04 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:04 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:04 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:04 user nova-compute[75734]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de (non-flash)
Nov 22 16:07:04 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:04 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac6b31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de'): ({'sdg'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Removing single pathed devices sdg {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec000e54-534e-4754-a688-9a02914e2a5c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[92baf3f7-e916-44b2-a511-6cecf64fb23e]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flushing IO for device /dev/sdg {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccffd5d-d18a-4820-9b88-144283900078]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5024dbf-b567-4510-9ce3-c9c98da3a123]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] SCSI volumes sdg have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21de75d-0d74-414d-8ca3-f7f6257bde97]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ebf22-88f8-4f81-853a-13d4ef16279e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260]
Nov 22 16:07:04 user nova-compute[75734]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de, portal: 172.16.0.220,3260] successful.
Nov 22 16:07:04 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7178529-a0fe-4c6d-a6f5-ebb51c1428de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8dcd2f-c17e-4322-930a-7f4c3a943b09]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== disconnect_volume: return (321ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Releasing lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance network_info: |[{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] Acquired lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Start _get_guest_xml network_info=[{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:07:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:07:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620964655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620964655',id=28,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmRWp0lXL5zod5s9sYt+qGZu5jWt0PCTA0Lz99UUZtBPolfaBx/0PgEMrfmNx63spio9CBxImcNyZ9sgtuvAJVMhrZSPXwEbGhUbTuC49SxVzf9SuCFPgZ69Y7Qjw8RA==',key_name='tempest-keypair-1677415622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-dgsvht2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=0bb36614-4020-4eb5-81b3-f8e9a5f43541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:07:04 user nova-compute[75734]:   <uuid>0bb36614-4020-4eb5-81b3-f8e9a5f43541</uuid>
Nov 22 16:07:04 user nova-compute[75734]:   <name>instance-0000001c</name>
Nov 22 16:07:04 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:07:04 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:07:04 user nova-compute[75734]:   <metadata>
Nov 22 16:07:04 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:07:04 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:07:04 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-620964655</nova:name>
Nov 22 16:07:04 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:07:04</nova:creationTime>
Nov 22 16:07:04 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:07:04 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:07:04 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:07:04 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:07:04 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:07:04 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:07:04 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:07:04 user nova-compute[75734]:       <nova:owner>
Nov 22 16:07:04 user nova-compute[75734]:         <nova:user uuid="4c444f0bec7641458313d99ebcac79e1">tempest-AttachVolumeShelveTestJSON-1751141796-project-member</nova:user>
Nov 22 16:07:04 user nova-compute[75734]:         <nova:project uuid="c0470a32bf194b2ca5de3bd71af4409d">tempest-AttachVolumeShelveTestJSON-1751141796</nova:project>
Nov 22 16:07:04 user nova-compute[75734]:       </nova:owner>
Nov 22 16:07:04 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:07:04 user nova-compute[75734]:       <nova:ports>
Nov 22 16:07:04 user nova-compute[75734]:         <nova:port uuid="c5d05c23-c676-43f3-845f-bf210be313b2">
Nov 22 16:07:04 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 16:07:04 user nova-compute[75734]:         </nova:port>
Nov 22 16:07:04 user nova-compute[75734]:       </nova:ports>
Nov 22 16:07:04 user nova-compute[75734]:     </nova:instance>
Nov 22 16:07:04 user nova-compute[75734]:   </metadata>
Nov 22 16:07:04 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:07:04 user nova-compute[75734]:     <system>
Nov 22 16:07:04 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:07:04 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:07:04 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:07:04 user nova-compute[75734]:       <entry name="serial">0bb36614-4020-4eb5-81b3-f8e9a5f43541</entry>
Nov 22 16:07:04 user nova-compute[75734]:       <entry name="uuid">0bb36614-4020-4eb5-81b3-f8e9a5f43541</entry>
Nov 22 16:07:04 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:07:04 user nova-compute[75734]:     </system>
Nov 22 16:07:04 user nova-compute[75734]:   </sysinfo>
Nov 22 16:07:04 user nova-compute[75734]:   <os>
Nov 22 16:07:04 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:07:04 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:07:04 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:07:04 user nova-compute[75734]:   </os>
Nov 22 16:07:04 user nova-compute[75734]:   <features>
Nov 22 16:07:04 user nova-compute[75734]:     <acpi/>
Nov 22 16:07:04 user nova-compute[75734]:     <apic/>
Nov 22 16:07:04 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:07:04 user nova-compute[75734]:   </features>
Nov 22 16:07:04 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:07:04 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:07:04 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:07:04 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:07:04 user nova-compute[75734]:   </clock>
Nov 22 16:07:04 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:07:04 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:07:04 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:07:04 user nova-compute[75734]:   </cpu>
Nov 22 16:07:04 user nova-compute[75734]:   <devices>
Nov 22 16:07:04 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:07:04 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:07:04 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk"/>
Nov 22 16:07:04 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:07:04 user nova-compute[75734]:     </disk>
Nov 22 16:07:04 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:07:04 user nova-compute[75734]:       <mac address="fa:16:3e:1f:99:4f"/>
Nov 22 16:07:04 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:07:04 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:07:04 user nova-compute[75734]:       <target dev="tapc5d05c23-c6"/>
Nov 22 16:07:04 user nova-compute[75734]:     </interface>
Nov 22 16:07:04 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:07:04 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/console.log" append="off"/>
Nov 22 16:07:04 user nova-compute[75734]:     </serial>
Nov 22 16:07:04 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:07:04 user nova-compute[75734]:     <video>
Nov 22 16:07:04 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:07:04 user nova-compute[75734]:     </video>
Nov 22 16:07:04 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:07:04 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:07:04 user nova-compute[75734]:     </rng>
Nov 22 16:07:04 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:07:04 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:07:04 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:07:04 user nova-compute[75734]:     </memballoon>
Nov 22 16:07:04 user nova-compute[75734]:   </devices>
Nov 22 16:07:04 user nova-compute[75734]: </domain>
Nov 22 16:07:04 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620964655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620964655',id=28,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmRWp0lXL5zod5s9sYt+qGZu5jWt0PCTA0Lz99UUZtBPolfaBx/0PgEMrfmNx63spio9CBxImcNyZ9sgtuvAJVMhrZSPXwEbGhUbTuC49SxVzf9SuCFPgZ69Y7Qjw8RA==',key_name='tempest-keypair-1677415622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-dgsvht2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=0bb36614-4020-4eb5-81b3-f8e9a5f43541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:07:04 user nova-compute[75734]: DEBUG os_vif [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c8ff4b1-9509-54b3-99a8-25bdab347c76', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5d05c23-c6, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5d05c23-c6, col_values=(('qos', UUID('0658179e-c9d5-495d-a4b0-fc859e04ebec')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5d05c23-c6, col_values=(('external_ids', {'iface-id': 'c5d05c23-c676-43f3-845f-bf210be313b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:99:4f', 'vm-uuid': '0bb36614-4020-4eb5-81b3-f8e9a5f43541'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:05 user nova-compute[75734]: INFO os_vif [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6')
Nov 22 16:07:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No VIF found with MAC fa:16:3e:1f:99:4f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRBgzWFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:07:05 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:07:05 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:07:05 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[18048d33-7792-410c-8f9d-9c5088f8c55f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:07:05 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01045da-f22b-4bd1-b4d0-93c9446f35b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863] added
Nov 22 16:07:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37d601-a6de-4ae9-9c2a-7d85bad4bd0f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b0d7b6-2787-4f56-995b-a921f9570ad6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRBgzWFf {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRBgzWFf" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[413209d6-2e3a-460a-b312-ff3d91521448]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cRBgzWFf'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a58f8-b6df-4be4-9e4a-8693b5d19b79]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1746d4-35da-46b9-91f4-f342d9b8546b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.volume.cinder [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Update attachment failed for attachment fb863d33-56d3-443b-b97c-0a0a641fc8a0. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Traceback (most recent call last):
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self.driver.rebuild(**kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     raise NotImplementedError()
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] NotImplementedError
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] During handling of the above exception, another exception occurred:
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Traceback (most recent call last):
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     driver_block_device.attach_block_devices(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     _log_and_attach(device)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     bdm.attach(*attach_args, **attach_kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     ret_val = method(obj, context, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self._do_attach(context, instance, volume, volume_api,
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self._volume_attach(context, volume, connector, instance,
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     connection_info = volume_api.attachment_update(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     res = method(self, ctx, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     with excutils.save_and_reraise_exception():
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self.force_reraise()
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     raise self.value
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     context, '3.44', skip_version_check=True).attachments.update(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     return method.func(obj, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     resp = self._update('/attachments/%s' % id, body)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     return self._cs_request(url, 'PUT', **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     return self.request(url, method, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     raise exceptions.from_response(resp, body)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9107067-6290-4564-aaa7-6c2d9012ee40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260]
Nov 22 16:07:05 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260] successful.
Nov 22 16:07:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG nova.objects.instance [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'flavor' on Instance uuid 452d0048-4b11-40f4-b004-d7ded6232e54 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[68652004-0e46-4e7b-821a-8531b91f43c7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6690d-8e56-495a-92aa-48f8d117a5a5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 (non-flash)
Nov 22 16:07:05 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-70fba388-3136-4162-bd1d-704bcbd4faba tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.018s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6813ba4-d7ca-4928-847e-6ac15b98961b]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRBgzWFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG nova.compute.utils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26) {{(pid=75734) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Traceback (most recent call last):
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self.driver.rebuild(**kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     raise NotImplementedError()
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] NotImplementedError
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] During handling of the above exception, another exception occurred:
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Traceback (most recent call last):
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     driver_block_device.attach_block_devices(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     _log_and_attach(device)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     bdm.attach(*attach_args, **attach_kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     ret_val = method(obj, context, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self._do_attach(context, instance, volume, volume_api,
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self._volume_attach(context, volume, connector, instance,
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     connection_info = volume_api.attachment_update(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     res = method(self, ctx, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     with excutils.save_and_reraise_exception():
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self.force_reraise()
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     raise self.value
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     context, '3.44', skip_version_check=True).attachments.update(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     return method.func(obj, *args, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     resp = self._update('/attachments/%s' % id, body)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     return self._cs_request(url, 'PUT', **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     return self.request(url, method, **kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     raise exceptions.from_response(resp, body)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] During handling of the above exception, another exception occurred:
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Traceback (most recent call last):
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     yield
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self._do_rebuild_instance_with_claim(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self._do_rebuild_instance(
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     self._rebuild_default_impl(**kwargs)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90]     raise exception.InvalidBDM(str(ex))
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:05 user nova-compute[75734]: ERROR nova.compute.manager [instance: faaf4403-3509-4b15-af7b-37fefceafa90] 
Nov 22 16:07:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updated VIF entry in instance network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG nova.network.neutron [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5bfead85-3fdd-479b-b99e-5a7e0fd5d43a req-a8f82b92-14f1-482b-a74e-2c678e486b12 service nova] Releasing lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:06 user nova-compute[75734]: INFO nova.compute.manager [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server [None req-e9133539-8921-4793-8f8c-5f06c5c725d7 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server 
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server 
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server 
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server 
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef246e6f-ab85-4cd6-8d48-f6d136b19c26)
Nov 22 16:07:06 user nova-compute[75734]: ERROR oslo_messaging.rpc.server 
Nov 22 16:07:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-77201d24-aac9-412b-9f1f-40365dbfefa4 req-4be07a63-58c2-4170-a4cf-081d3c136980 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-77201d24-aac9-412b-9f1f-40365dbfefa4 req-4be07a63-58c2-4170-a4cf-081d3c136980 service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-77201d24-aac9-412b-9f1f-40365dbfefa4 req-4be07a63-58c2-4170-a4cf-081d3c136980 service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-77201d24-aac9-412b-9f1f-40365dbfefa4 req-4be07a63-58c2-4170-a4cf-081d3c136980 service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-77201d24-aac9-412b-9f1f-40365dbfefa4 req-4be07a63-58c2-4170-a4cf-081d3c136980 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:07:06 user nova-compute[75734]: WARNING nova.compute.manager [req-77201d24-aac9-412b-9f1f-40365dbfefa4 req-4be07a63-58c2-4170-a4cf-081d3c136980 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received unexpected event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with vm_state building and task_state spawning.
Nov 22 16:07:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23435383233306461', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435383233306461', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG nova.objects.instance [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:07:06 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:07:06 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:07:06 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:07:06 user nova-compute[75734]:   <serial>4e52754c-b077-48f5-8c1d-030738a41863</serial>
Nov 22 16:07:06 user nova-compute[75734]: </disk>
Nov 22 16:07:06 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:07:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:07:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:07:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No VIF found with MAC fa:16:3e:de:13:28, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:07:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-34a943e1-6557-4491-8735-2beb269ead9f tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.526s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-653c4c88-8820-4fac-8063-749a6818d174 req-397658c5-9838-44c2-a63d-f0db2961ec5f service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-653c4c88-8820-4fac-8063-749a6818d174 req-397658c5-9838-44c2-a63d-f0db2961ec5f service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-653c4c88-8820-4fac-8063-749a6818d174 req-397658c5-9838-44c2-a63d-f0db2961ec5f service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-653c4c88-8820-4fac-8063-749a6818d174 req-397658c5-9838-44c2-a63d-f0db2961ec5f service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-653c4c88-8820-4fac-8063-749a6818d174 req-397658c5-9838-44c2-a63d-f0db2961ec5f service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:07:08 user nova-compute[75734]: WARNING nova.compute.manager [req-653c4c88-8820-4fac-8063-749a6818d174 req-397658c5-9838-44c2-a63d-f0db2961ec5f service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received unexpected event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with vm_state building and task_state spawning.
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:07:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance spawned successfully.
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:08 user nova-compute[75734]: INFO nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 22 16:07:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:07:09 user nova-compute[75734]: INFO nova.compute.manager [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Took 7.26 seconds to build instance.
Nov 22 16:07:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2397e362-801c-4c3f-8859-1b1e71ff5aff tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.381s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:09 user nova-compute[75734]: INFO nova.compute.manager [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Detaching volume 4e52754c-b077-48f5-8c1d-030738a41863
Nov 22 16:07:09 user nova-compute[75734]: INFO nova.virt.block_device [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attempting to driver detach volume 4e52754c-b077-48f5-8c1d-030738a41863 from mountpoint /dev/vdb
Nov 22 16:07:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Attempting to detach device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:07:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:07:09 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:07:09 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:07:09 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:07:09 user nova-compute[75734]:   <serial>4e52754c-b077-48f5-8c1d-030738a41863</serial>
Nov 22 16:07:09 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:07:09 user nova-compute[75734]: </disk>
Nov 22 16:07:09 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:07:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config.
Nov 22 16:07:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:07:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:07:09 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:07:09 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:07:09 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:07:09 user nova-compute[75734]:   <serial>4e52754c-b077-48f5-8c1d-030738a41863</serial>
Nov 22 16:07:09 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:07:09 user nova-compute[75734]: </disk>
Nov 22 16:07:09 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:07:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:07:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing instance network info cache due to event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] Acquiring lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] Acquired lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updated VIF entry in instance network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a1469339-10e0-4bc8-aca7-37e8593f5aee req-ef5fc2fd-8f8e-4303-9804-4aadcae6886d service nova] Releasing lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:19 user nova-compute[75734]: INFO nova.compute.manager [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Detaching volume 61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:07:19 user nova-compute[75734]: INFO nova.virt.block_device [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Attempting to driver detach volume 61c30cb0-2151-46fe-9692-786d84ba14d7 from mountpoint /dev/vdb
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Attempting to detach device vdb from instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:07:19 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:07:19 user nova-compute[75734]:   <source dev="/dev/sdf"/>
Nov 22 16:07:19 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:07:19 user nova-compute[75734]:   <serial>61c30cb0-2151-46fe-9692-786d84ba14d7</serial>
Nov 22 16:07:19 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:07:19 user nova-compute[75734]: </disk>
Nov 22 16:07:19 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:07:19 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully detached device vdb from instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c from the persistent domain config.
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:07:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:07:19 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:07:19 user nova-compute[75734]:   <source dev="/dev/sdf"/>
Nov 22 16:07:19 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:07:19 user nova-compute[75734]:   <serial>61c30cb0-2151-46fe-9692-786d84ba14d7</serial>
Nov 22 16:07:19 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:07:19 user nova-compute[75734]: </disk>
Nov 22 16:07:19 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:07:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing instance network info cache due to event network-changed-05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] Acquiring lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] Acquired lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG nova.network.neutron [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Refreshing network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG nova.network.neutron [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updated VIF entry in instance network info cache for port 05b840f9-4c08-477c-99c5-72dcd541d8e6. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG nova.network.neutron [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [{"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-36d9ae33-eea2-4627-8d2b-369962f73741 req-b8d35890-d0ae-4960-aa5b-426093077b4d service nova] Releasing lock "refresh_cache-15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:07:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:30 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c is timed out.
Nov 22 16:07:30 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config.
Nov 22 16:07:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRBgzWFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:07:30 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.140s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c35ebe9-60fa-47a4-84dd-ba028eb65595]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:07:30 user nova-compute[75734]: No targets found.
Nov 22 16:07:30 user nova-compute[75734]: iSNS:
Nov 22 16:07:30 user nova-compute[75734]: No targets found.
Nov 22 16:07:30 user nova-compute[75734]: STATIC:
Nov 22 16:07:30 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:07:30 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:30 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:30 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:07:30 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:30 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:30 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863
Nov 22 16:07:30 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:30 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:30 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:07:30 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:30 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:30 user nova-compute[75734]: FIRMWARE:
Nov 22 16:07:30 user nova-compute[75734]: No targets found.
Nov 22 16:07:30 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:07:30 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:07:30 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d060c2-7e41-4746-b110-5e4c51b47097]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37d750-f714-4aba-80bf-4b49b61d3be7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:30 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:30 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:30 user nova-compute[75734]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 (non-flash)
Nov 22 16:07:30 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:30 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:30 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:30 user nova-compute[75734]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 (non-flash)
Nov 22 16:07:30 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc3212d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f05374b-a1b6-4c5a-ab8e-b9f67927de2c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c33ae-516a-4674-a7e6-5579d5921d66]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b6135-5eb0-45cd-93c3-93bd761abd07]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d58e8-ce4e-478b-8101-b558285a946a]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f372de77-5f2e-4384-bdb4-9afba7883bfe]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8667bd9-2970-4084-8e04-510a43de8afb]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260]
Nov 22 16:07:30 user nova-compute[75734]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863, portal: 172.16.0.220,3260] successful.
Nov 22 16:07:30 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e52754c-b077-48f5-8c1d-030738a41863 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e7c633-dced-447f-8e43-22a6987facb4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== disconnect_volume: return (445ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:07:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:31 user nova-compute[75734]: DEBUG nova.objects.instance [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-165d983a-847e-4070-826a-c3e2ad5aec43 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.004s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:32 user nova-compute[75734]: INFO nova.compute.manager [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Terminating instance
Nov 22 16:07:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:07:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] During wait destroy, instance disappeared. {{(pid=75734) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 22 16:07:32 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Instance destroyed successfully.
Nov 22 16:07:32 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lazy-loading 'resources' on Instance uuid faaf4403-3509-4b15-af7b-37fefceafa90 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1830407483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-368242086',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1lFGCe2iwvxzcqx/e0m218xdfEp4o6zmPD135gbBimZfV3uea5k9we8/wkfVlBFFAXo5oOOEZdO+JYh7H8YExi8cSWlkVPmnJYwesCHup3pLg3ssqFQsdmV/JYQXT84Q==',key_name='tempest-keypair-378398179',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1907da4ebb34a77ab650d943f728f98',ramdisk_id='',reservation_id='r-vyfkrzww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1321099151',owner_user_name='tempest-ServerActionsV293TestJSON-1321099151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e6a31c87c74976b0d7aae6280cfd25',uuid=faaf4403-3509-4b15-af7b-37fefceafa90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converting VIF {"id": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "address": "fa:16:3e:3f:ca:21", "network": {"id": "b92d1073-6300-4c7c-9779-310d4d1d9028", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1787355126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1907da4ebb34a77ab650d943f728f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9eb5093-28", "ovs_interfaceid": "b9eb5093-2818-45ae-ba0d-29ef0405420e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_vif [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9eb5093-28, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:07:33 user nova-compute[75734]: INFO os_vif [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ca:21,bridge_name='br-int',has_traffic_filtering=True,id=b9eb5093-2818-45ae-ba0d-29ef0405420e,network=Network(b92d1073-6300-4c7c-9779-310d4d1d9028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9eb5093-28')
Nov 22 16:07:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhvLNPdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:07:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e924db3-916d-4e7a-bca8-ab4b90884858]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:07:33 user nova-compute[75734]: No targets found.
Nov 22 16:07:33 user nova-compute[75734]: iSNS:
Nov 22 16:07:33 user nova-compute[75734]: No targets found.
Nov 22 16:07:33 user nova-compute[75734]: STATIC:
Nov 22 16:07:33 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:07:33 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:33 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:33 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:07:33 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:33 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:33 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:07:33 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:33 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:33 user nova-compute[75734]: FIRMWARE:
Nov 22 16:07:33 user nova-compute[75734]: No targets found.
Nov 22 16:07:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:07:33 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:07:33 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b8dab8-3e7c-4e0e-afee-a43c002be647', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2dc6be-8624-4abb-8111-5b1dcae2c922]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[21abcc76-8928-4cd6-8018-49b565434ccc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:33 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:33 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:33 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:33 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc321e10>, {}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Disconnecting from: [] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] <== disconnect_volume: return (78ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:07:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Deletion of /opt/stack/data/nova/instances/faaf4403-3509-4b15-af7b-37fefceafa90_del complete
Nov 22 16:07:33 user nova-compute[75734]: INFO nova.compute.manager [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Took 0.18 seconds to destroy the instance on the hypervisor.
Nov 22 16:07:33 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:07:33 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.compute.manager [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Terminating instance
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-b922effc-21a9-4c43-b8b9-5bc6ac1b501c req-508badff-00ab-4f56-9ed5-615f94cbe824 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-unplugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b922effc-21a9-4c43-b8b9-5bc6ac1b501c req-508badff-00ab-4f56-9ed5-615f94cbe824 service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b922effc-21a9-4c43-b8b9-5bc6ac1b501c req-508badff-00ab-4f56-9ed5-615f94cbe824 service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b922effc-21a9-4c43-b8b9-5bc6ac1b501c req-508badff-00ab-4f56-9ed5-615f94cbe824 service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-b922effc-21a9-4c43-b8b9-5bc6ac1b501c req-508badff-00ab-4f56-9ed5-615f94cbe824 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-unplugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-b922effc-21a9-4c43-b8b9-5bc6ac1b501c req-508badff-00ab-4f56-9ed5-615f94cbe824 service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-unplugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Took 1.21 seconds to deallocate network for instance.
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-dcaf77fa-8edd-47b9-b6e7-ab3e1c63dfbc req-b0d2101a-0a2e-49c2-ac7b-905d897bceed service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Received event network-vif-deleted-b9eb5093-2818-45ae-ba0d-29ef0405420e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.compute.manager [req-dcaf77fa-8edd-47b9-b6e7-ab3e1c63dfbc req-b0d2101a-0a2e-49c2-ac7b-905d897bceed service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Neutron deleted interface b9eb5093-2818-45ae-ba0d-29ef0405420e; detaching it from the instance and deleting it from the info cache
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-dcaf77fa-8edd-47b9-b6e7-ab3e1c63dfbc req-b0d2101a-0a2e-49c2-ac7b-905d897bceed service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-dcaf77fa-8edd-47b9-b6e7-ab3e1c63dfbc req-b0d2101a-0a2e-49c2-ac7b-905d897bceed service nova] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Detach interface failed, port_id=b9eb5093-2818-45ae-ba0d-29ef0405420e, reason: Instance faaf4403-3509-4b15-af7b-37fefceafa90 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.compute.manager [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Took 0.16 seconds to detach 1 volumes for instance.
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] [instance: faaf4403-3509-4b15-af7b-37fefceafa90] Deleting volume: d6b8dab8-3e7c-4e0e-afee-a43c002be647 {{(pid=75734) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Instance destroyed successfully.
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'resources' on Instance uuid 452d0048-4b11-40f4-b004-d7ded6232e54 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-621823763',display_name='tempest-ServerActionsTestOtherA-server-642600834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-621823763',id=22,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYitI8eNfB1WQDTrUNK8TBNh++AzBu18shj48L/hxhb5AEOAgsFIsMhpBNoR4suzzbEiyjKSGcIzZd665wV8TzuxDG7wFiixXZlqj4I6VD8gFswGXXpxAkFJiROJrAq6g==',key_name='tempest-keypair-1609171650',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:04:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-6veorgxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=452d0048-4b11-40f4-b004-d7ded6232e54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "8096492b-5d84-445a-8b97-d5bcbabef66c", "address": "fa:16:3e:39:d8:f4", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8096492b-5d", "ovs_interfaceid": "8096492b-5d84-445a-8b97-d5bcbabef66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG os_vif [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8096492b-5d, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=135fe87e-2db8-42ec-8aa3-583af637ae91) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:07:34 user nova-compute[75734]: INFO os_vif [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:d8:f4,bridge_name='br-int',has_traffic_filtering=True,id=8096492b-5d84-445a-8b97-d5bcbabef66c,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8096492b-5d')
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Deleting instance files /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54_del
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Deletion of /opt/stack/data/nova/instances/452d0048-4b11-40f4-b004-d7ded6232e54_del complete
Nov 22 16:07:34 user nova-compute[75734]: INFO nova.compute.manager [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 22 16:07:34 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:07:34 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.409s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:07:35 user nova-compute[75734]: INFO nova.compute.claims [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Claim successful on node user
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cc66dea8-7c96-41bb-a3b9-c7b2b1239790 tempest-ServerActionsV293TestJSON-1321099151 tempest-ServerActionsV293TestJSON-1321099151-project-member] Lock "faaf4403-3509-4b15-af7b-37fefceafa90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:07:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:07:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Creating image(s)
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "/opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "/opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "/opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.policy [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '597c8b8d69be41ed9805ebe54eacf56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b505b41b594e83a92d18fd185d07de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.202s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk 1073741824" returned: 0 in 0.053s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-334e6536-ba81-4dbd-8136-e2a8a1cb74c9 req-7e25d194-d1f5-494a-b130-d534c0d83f9f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-334e6536-ba81-4dbd-8136-e2a8a1cb74c9 req-7e25d194-d1f5-494a-b130-d534c0d83f9f service nova] Acquiring lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-334e6536-ba81-4dbd-8136-e2a8a1cb74c9 req-7e25d194-d1f5-494a-b130-d534c0d83f9f service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-334e6536-ba81-4dbd-8136-e2a8a1cb74c9 req-7e25d194-d1f5-494a-b130-d534c0d83f9f service nova] Lock "452d0048-4b11-40f4-b004-d7ded6232e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-334e6536-ba81-4dbd-8136-e2a8a1cb74c9 req-7e25d194-d1f5-494a-b130-d534c0d83f9f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] No waiting events found dispatching network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:07:36 user nova-compute[75734]: WARNING nova.compute.manager [req-334e6536-ba81-4dbd-8136-e2a8a1cb74c9 req-7e25d194-d1f5-494a-b130-d534c0d83f9f service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received unexpected event network-vif-plugged-8096492b-5d84-445a-8b97-d5bcbabef66c for instance with vm_state active and task_state deleting.
Nov 22 16:07:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-52d7e330-0ab3-4b48-a751-201b46ad61a1 req-ada07ec7-df1b-4e0a-8e1b-d5353e8362ac service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Received event network-vif-deleted-8096492b-5d84-445a-8b97-d5bcbabef66c {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:36 user nova-compute[75734]: INFO nova.compute.manager [req-52d7e330-0ab3-4b48-a751-201b46ad61a1 req-ada07ec7-df1b-4e0a-8e1b-d5353e8362ac service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Neutron deleted interface 8096492b-5d84-445a-8b97-d5bcbabef66c; detaching it from the instance and deleting it from the info cache
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.network.neutron [req-52d7e330-0ab3-4b48-a751-201b46ad61a1 req-ada07ec7-df1b-4e0a-8e1b-d5353e8362ac service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:36 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Took 1.70 seconds to deallocate network for instance.
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-52d7e330-0ab3-4b48-a751-201b46ad61a1 req-ada07ec7-df1b-4e0a-8e1b-d5353e8362ac service nova] [instance: 452d0048-4b11-40f4-b004-d7ded6232e54] Detach interface failed, port_id=8096492b-5d84-445a-8b97-d5bcbabef66c, reason: Instance 452d0048-4b11-40f4-b004-d7ded6232e54 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Cannot resize image /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Ensure instance console log exists: /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Successfully created port: 6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:37 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Deleted allocations for instance 452d0048-4b11-40f4-b004-d7ded6232e54
Nov 22 16:07:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d6c141dd-e0f6-4607-9833-9e648cbd9041 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "452d0048-4b11-40f4-b004-d7ded6232e54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.217s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Successfully updated port: 6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquired lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updating instance_info_cache with network_info: [{"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Releasing lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Instance network_info: |[{"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Start _get_guest_xml network_info=[{"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:07:37 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:07:37 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1616324435',display_name='tempest-TestServerVolumeAttachmentScenario-server-1616324435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1616324435',id=29,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUBeDrWHVkjGsYNXd/sThdrXSEHumPCYxN24EA6L5ytK+pvApZO9Ay8RNHnuiz73PlABB9rWzNte1HTOm+2AnpbmzCPw2GpeocY34fvNKL5HY6bzfqsnBHXUnAkEaPjgg==',key_name='tempest-keypair-105430493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69b505b41b594e83a92d18fd185d07de',ramdisk_id='',reservation_id='r-63tmtnk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1780334771',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1780334771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597c8b8d69be41ed9805ebe54eacf56a',uuid=82a9e313-f7b9-4288-8fa7-0b8d55a70957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Converting VIF {"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:19:9e,bridge_name='br-int',has_traffic_filtering=True,id=6def8f4d-d8e9-4b33-813e-53ab26748d30,network=Network(f4ba4655-de99-4a87-b386-965f13e87179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6def8f4d-d8') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'pci_devices' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:07:37 user nova-compute[75734]:   <uuid>82a9e313-f7b9-4288-8fa7-0b8d55a70957</uuid>
Nov 22 16:07:37 user nova-compute[75734]:   <name>instance-0000001d</name>
Nov 22 16:07:37 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:07:37 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:07:37 user nova-compute[75734]:   <metadata>
Nov 22 16:07:37 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:07:37 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:07:37 user nova-compute[75734]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1616324435</nova:name>
Nov 22 16:07:37 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:07:37</nova:creationTime>
Nov 22 16:07:37 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:07:37 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:07:37 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:07:37 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:07:37 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:07:37 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:07:37 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:07:37 user nova-compute[75734]:       <nova:owner>
Nov 22 16:07:37 user nova-compute[75734]:         <nova:user uuid="597c8b8d69be41ed9805ebe54eacf56a">tempest-TestServerVolumeAttachmentScenario-1780334771-project-member</nova:user>
Nov 22 16:07:37 user nova-compute[75734]:         <nova:project uuid="69b505b41b594e83a92d18fd185d07de">tempest-TestServerVolumeAttachmentScenario-1780334771</nova:project>
Nov 22 16:07:37 user nova-compute[75734]:       </nova:owner>
Nov 22 16:07:37 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:07:37 user nova-compute[75734]:       <nova:ports>
Nov 22 16:07:37 user nova-compute[75734]:         <nova:port uuid="6def8f4d-d8e9-4b33-813e-53ab26748d30">
Nov 22 16:07:37 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 16:07:37 user nova-compute[75734]:         </nova:port>
Nov 22 16:07:37 user nova-compute[75734]:       </nova:ports>
Nov 22 16:07:37 user nova-compute[75734]:     </nova:instance>
Nov 22 16:07:37 user nova-compute[75734]:   </metadata>
Nov 22 16:07:37 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:07:37 user nova-compute[75734]:     <system>
Nov 22 16:07:37 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:07:37 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:07:37 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:07:37 user nova-compute[75734]:       <entry name="serial">82a9e313-f7b9-4288-8fa7-0b8d55a70957</entry>
Nov 22 16:07:37 user nova-compute[75734]:       <entry name="uuid">82a9e313-f7b9-4288-8fa7-0b8d55a70957</entry>
Nov 22 16:07:37 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:07:37 user nova-compute[75734]:     </system>
Nov 22 16:07:37 user nova-compute[75734]:   </sysinfo>
Nov 22 16:07:37 user nova-compute[75734]:   <os>
Nov 22 16:07:37 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:07:37 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:07:37 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:07:37 user nova-compute[75734]:   </os>
Nov 22 16:07:37 user nova-compute[75734]:   <features>
Nov 22 16:07:37 user nova-compute[75734]:     <acpi/>
Nov 22 16:07:37 user nova-compute[75734]:     <apic/>
Nov 22 16:07:37 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:07:37 user nova-compute[75734]:   </features>
Nov 22 16:07:37 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:07:37 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:07:37 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:07:37 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:07:37 user nova-compute[75734]:   </clock>
Nov 22 16:07:37 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:07:37 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:07:37 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:07:37 user nova-compute[75734]:   </cpu>
Nov 22 16:07:37 user nova-compute[75734]:   <devices>
Nov 22 16:07:37 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:07:37 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:07:37 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk"/>
Nov 22 16:07:37 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:07:37 user nova-compute[75734]:     </disk>
Nov 22 16:07:37 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:07:37 user nova-compute[75734]:       <mac address="fa:16:3e:04:19:9e"/>
Nov 22 16:07:37 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:07:37 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:07:37 user nova-compute[75734]:       <target dev="tap6def8f4d-d8"/>
Nov 22 16:07:37 user nova-compute[75734]:     </interface>
Nov 22 16:07:37 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:07:37 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/console.log" append="off"/>
Nov 22 16:07:37 user nova-compute[75734]:     </serial>
Nov 22 16:07:37 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:07:37 user nova-compute[75734]:     <video>
Nov 22 16:07:37 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:07:37 user nova-compute[75734]:     </video>
Nov 22 16:07:37 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:07:37 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:07:37 user nova-compute[75734]:     </rng>
Nov 22 16:07:37 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:07:37 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:07:37 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:07:37 user nova-compute[75734]:     </memballoon>
Nov 22 16:07:37 user nova-compute[75734]:   </devices>
Nov 22 16:07:37 user nova-compute[75734]: </domain>
Nov 22 16:07:37 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1616324435',display_name='tempest-TestServerVolumeAttachmentScenario-server-1616324435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1616324435',id=29,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUBeDrWHVkjGsYNXd/sThdrXSEHumPCYxN24EA6L5ytK+pvApZO9Ay8RNHnuiz73PlABB9rWzNte1HTOm+2AnpbmzCPw2GpeocY34fvNKL5HY6bzfqsnBHXUnAkEaPjgg==',key_name='tempest-keypair-105430493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69b505b41b594e83a92d18fd185d07de',ramdisk_id='',reservation_id='r-63tmtnk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1780334771',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1780334771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597c8b8d69be41ed9805ebe54eacf56a',uuid=82a9e313-f7b9-4288-8fa7-0b8d55a70957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Converting VIF {"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:19:9e,bridge_name='br-int',has_traffic_filtering=True,id=6def8f4d-d8e9-4b33-813e-53ab26748d30,network=Network(f4ba4655-de99-4a87-b386-965f13e87179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6def8f4d-d8') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG os_vif [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:19:9e,bridge_name='br-int',has_traffic_filtering=True,id=6def8f4d-d8e9-4b33-813e-53ab26748d30,network=Network(f4ba4655-de99-4a87-b386-965f13e87179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6def8f4d-d8') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63f80e06-e11b-56ef-8802-b119ecfa095b', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6def8f4d-d8, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6def8f4d-d8, col_values=(('qos', UUID('eec7b1fa-23a9-40de-9ca9-61aa31c32ead')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6def8f4d-d8, col_values=(('external_ids', {'iface-id': '6def8f4d-d8e9-4b33-813e-53ab26748d30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:19:9e', 'vm-uuid': '82a9e313-f7b9-4288-8fa7-0b8d55a70957'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:37 user nova-compute[75734]: INFO os_vif [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:19:9e,bridge_name='br-int',has_traffic_filtering=True,id=6def8f4d-d8e9-4b33-813e-53ab26748d30,network=Network(f4ba4655-de99-4a87-b386-965f13e87179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6def8f4d-d8')
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:07:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No VIF found with MAC fa:16:3e:04:19:9e, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:07:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-changed-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Refreshing instance network info cache due to event network-changed-6def8f4d-d8e9-4b33-813e-53ab26748d30. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:07:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] Acquiring lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:07:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] Acquired lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:07:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Refreshing network info cache for port 6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updated VIF entry in instance network info cache for port 6def8f4d-d8e9-4b33-813e-53ab26748d30. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG nova.network.neutron [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updating instance_info_cache with network_info: [{"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c201e4cf-f381-4063-8f8b-7a31a48d7962 req-b90206f0-1f8b-42c3-a29c-c2d6d16cb5e4 service nova] Releasing lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-8412396b-9514-4533-8438-e312e071a3e2 req-0fcd5fc2-329c-47f6-afce-78f45b686cfa service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8412396b-9514-4533-8438-e312e071a3e2 req-0fcd5fc2-329c-47f6-afce-78f45b686cfa service nova] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8412396b-9514-4533-8438-e312e071a3e2 req-0fcd5fc2-329c-47f6-afce-78f45b686cfa service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8412396b-9514-4533-8438-e312e071a3e2 req-0fcd5fc2-329c-47f6-afce-78f45b686cfa service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-8412396b-9514-4533-8438-e312e071a3e2 req-0fcd5fc2-329c-47f6-afce-78f45b686cfa service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] No waiting events found dispatching network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:07:39 user nova-compute[75734]: WARNING nova.compute.manager [req-8412396b-9514-4533-8438-e312e071a3e2 req-0fcd5fc2-329c-47f6-afce-78f45b686cfa service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received unexpected event network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 for instance with vm_state building and task_state spawning.
Nov 22 16:07:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:40 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c is timed out.
Nov 22 16:07:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully detached device vdb from instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c from the live domain config.
Nov 22 16:07:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxaCyAGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:07:40 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[21efcb50-81e3-48ab-bd62-11c652ed7e7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:07:40 user nova-compute[75734]: No targets found.
Nov 22 16:07:40 user nova-compute[75734]: iSNS:
Nov 22 16:07:40 user nova-compute[75734]: No targets found.
Nov 22 16:07:40 user nova-compute[75734]: STATIC:
Nov 22 16:07:40 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:07:40 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:40 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:40 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:07:40 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:40 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:40 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7
Nov 22 16:07:40 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:07:40 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:07:40 user nova-compute[75734]: FIRMWARE:
Nov 22 16:07:40 user nova-compute[75734]: No targets found.
Nov 22 16:07:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:07:40 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:07:40 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c845788f-3efe-492a-a180-ef120b911981]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc0b49-8d6f-4d74-ab41-fe9c25194eb8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:40 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:07:40 user nova-compute[75734]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 (non-flash)
Nov 22 16:07:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:07:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ec40e5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7'): ({'sdf'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Removing single pathed devices sdf {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4cd49-5b66-48e7-bbad-9f96bb6fa2c4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3702d549-55e8-48c9-acde-0ed493ce4ed6]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Flushing IO for device /dev/sdf {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6574f690-7657-40ef-a59b-5efb56689dc8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d7abe-d27f-4393-8860-9a09b24f29ae]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] SCSI volumes sdf have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e6ae51-c8ed-48f8-a473-231ef8bf75e5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277ae88-8092-48ca-905c-23784b62cdeb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260]
Nov 22 16:07:40 user nova-compute[75734]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7, portal: 172.16.0.220,3260] successful.
Nov 22 16:07:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c30cb0-2151-46fe-9692-786d84ba14d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6684c-867c-4779-9210-a0bb73929288]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] <== disconnect_volume: return (299ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:07:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'flavor' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d00afb5-c852-44ad-80b6-7257637e8ef3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:07:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Instance spawned successfully.
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-800682e7-0ffd-4fbc-827a-e34169781099 req-af56194d-3d1f-477c-80e5-0c12dfc39fdb service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-800682e7-0ffd-4fbc-827a-e34169781099 req-af56194d-3d1f-477c-80e5-0c12dfc39fdb service nova] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-800682e7-0ffd-4fbc-827a-e34169781099 req-af56194d-3d1f-477c-80e5-0c12dfc39fdb service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-800682e7-0ffd-4fbc-827a-e34169781099 req-af56194d-3d1f-477c-80e5-0c12dfc39fdb service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-800682e7-0ffd-4fbc-827a-e34169781099 req-af56194d-3d1f-477c-80e5-0c12dfc39fdb service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] No waiting events found dispatching network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:07:41 user nova-compute[75734]: WARNING nova.compute.manager [req-800682e7-0ffd-4fbc-827a-e34169781099 req-af56194d-3d1f-477c-80e5-0c12dfc39fdb service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received unexpected event network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 for instance with vm_state building and task_state spawning.
Nov 22 16:07:41 user nova-compute[75734]: INFO nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 22 16:07:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:07:41 user nova-compute[75734]: INFO nova.compute.manager [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Took 7.01 seconds to build instance.
Nov 22 16:07:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-577e4a4e-1af8-4152-a2d0-c0684d33e924 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.104s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:07:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:07:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:07:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:01 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:08:01 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7402MB free_disk=24.801910400390625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 90daf829-e4b2-4f46-a915-d2374bb0896c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cee17c90-5f3f-4455-a696-4ba11cd02451 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 044c6387-321b-4616-82ef-d917efb9eaf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:08:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG nova.objects.instance [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:03 user nova-compute[75734]: INFO nova.compute.manager [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attaching volume 94ee13e7-69c3-41c9-a08a-4e7944339748 to /dev/vdb
Nov 22 16:08:03 user nova-compute[75734]: DEBUG os_brick.utils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7aac0c-d78f-467e-8726-e74b9c3f5caa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e9fed-6721-404a-804f-bd0b0d333ecd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ab51d7-e970-4771-9a08-ea0c5440edf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7440cc17-7ab2-4552-b7ab-d9a717a12d78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:08:03 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fae7a5-d54b-4fa1-94f7-dc857e1360a0]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG os_brick.utils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating existing volume attachment record: 586113e3-90c7-4c6a-b299-5845eb7c14a7 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:08:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:08:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:09 user nova-compute[75734]: INFO nova.compute.manager [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Terminating instance
Nov 22 16:08:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f3d3d11-36b2-4656-9cd7-6385e106bdcb req-acdf8d66-58af-4c2d-8dea-6e78a4361158 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f3d3d11-36b2-4656-9cd7-6385e106bdcb req-acdf8d66-58af-4c2d-8dea-6e78a4361158 service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f3d3d11-36b2-4656-9cd7-6385e106bdcb req-acdf8d66-58af-4c2d-8dea-6e78a4361158 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f3d3d11-36b2-4656-9cd7-6385e106bdcb req-acdf8d66-58af-4c2d-8dea-6e78a4361158 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f3d3d11-36b2-4656-9cd7-6385e106bdcb req-acdf8d66-58af-4c2d-8dea-6e78a4361158 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f3d3d11-36b2-4656-9cd7-6385e106bdcb req-acdf8d66-58af-4c2d-8dea-6e78a4361158 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-unplugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Instance destroyed successfully.
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.objects.instance [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'resources' on Instance uuid 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1052250505',display_name='tempest-ServerRescueNegativeTestJSON-server-1052250505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1052250505',id=19,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV+1ijUPIxlObi7Otae2ssSP0pilyTlOPtuJzQIeQzKupfZ+pUbwSRpE2UOpK5LFKQ8PTYGl1ziklby0PniLrCSyXVOTJ2L3HudeI/U9Ag02k4cBlmGTYLHNrflOILtfQ==',key_name='tempest-keypair-124342039',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-vwg1bjqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea603e7c80014f17a76fec19b54443c9',uuid=15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "address": "fa:16:3e:97:23:9f", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b840f9-4c", "ovs_interfaceid": "05b840f9-4c08-477c-99c5-72dcd541d8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG os_vif [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05b840f9-4c, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0cd40ec-6646-466f-8cc7-2a07ed172c54) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:10 user nova-compute[75734]: INFO os_vif [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=05b840f9-4c08-477c-99c5-72dcd541d8e6,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b840f9-4c')
Nov 22 16:08:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Deleting instance files /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c_del
Nov 22 16:08:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Deletion of /opt/stack/data/nova/instances/15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c_del complete
Nov 22 16:08:10 user nova-compute[75734]: INFO nova.compute.manager [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 22 16:08:10 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:08:10 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:08:11 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Took 0.85 seconds to deallocate network for instance.
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvktAxTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:08:11 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:08:11 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:08:11 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d0d1a-c9b7-4672-bcfb-8b2b260236ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:08:11 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99ae187-a655-486a-bfe1-04f29c3dee3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748] added
Nov 22 16:08:11 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a0b6b4-8105-4ec5-9253-69c655057d1b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf16455-e041-41b7-adb7-d9fa33a0de8a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvktAxTb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvktAxTb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8c1ba9-193f-49c8-8c01-1ab2ba5f2180]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JvktAxTb'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[57030763-42b5-4d0c-886e-063646ea71ce]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281b71f-0822-492b-b01f-d141b613866a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:12 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:12 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b6a898-9660-41fc-bae0-17a8c24230bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260]
Nov 22 16:08:12 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260] successful.
Nov 22 16:08:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65fa838-dbe4-4e75-94bd-6d284e758b9a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Deleted allocations for instance 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c225588-2640-43e0-82ec-87b8c8b7572b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:12 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:12 user nova-compute[75734]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 (non-flash)
Nov 22 16:08:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:12 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:12 user nova-compute[75734]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 (non-flash)
Nov 22 16:08:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7132b8a-5ed0-4f0e-9646-d4120775ac90]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvktAxTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-da052d0f-0d95-40a4-83ad-4dbcf20be515 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.331s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-0bd6149d-8baf-4247-b38b-15d398eb652e req-7a261dff-0732-45ce-8000-8c1b8b2e64e7 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0bd6149d-8baf-4247-b38b-15d398eb652e req-7a261dff-0732-45ce-8000-8c1b8b2e64e7 service nova] Acquiring lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0bd6149d-8baf-4247-b38b-15d398eb652e req-7a261dff-0732-45ce-8000-8c1b8b2e64e7 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0bd6149d-8baf-4247-b38b-15d398eb652e req-7a261dff-0732-45ce-8000-8c1b8b2e64e7 service nova] Lock "15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-0bd6149d-8baf-4247-b38b-15d398eb652e req-7a261dff-0732-45ce-8000-8c1b8b2e64e7 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] No waiting events found dispatching network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:12 user nova-compute[75734]: WARNING nova.compute.manager [req-0bd6149d-8baf-4247-b38b-15d398eb652e req-7a261dff-0732-45ce-8000-8c1b8b2e64e7 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received unexpected event network-vif-plugged-05b840f9-4c08-477c-99c5-72dcd541d8e6 for instance with vm_state deleted and task_state None.
Nov 22 16:08:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-0bd6149d-8baf-4247-b38b-15d398eb652e req-7a261dff-0732-45ce-8000-8c1b8b2e64e7 service nova] [instance: 15ddcb8d-3d05-4f54-8e2b-7da2aec7b60c] Received event network-vif-deleted-05b840f9-4c08-477c-99c5-72dcd541d8e6 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26162636165613363', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162636165613363', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG nova.objects.instance [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:08:13 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:08:13 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:08:13 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:08:13 user nova-compute[75734]:   <serial>94ee13e7-69c3-41c9-a08a-4e7944339748</serial>
Nov 22 16:08:13 user nova-compute[75734]: </disk>
Nov 22 16:08:13 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No VIF found with MAC fa:16:3e:de:13:28, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:08:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-93826d5e-f879-4ff0-9f16-9599e1a78792 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.792s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:16 user nova-compute[75734]: INFO nova.compute.manager [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Detaching volume 94ee13e7-69c3-41c9-a08a-4e7944339748
Nov 22 16:08:16 user nova-compute[75734]: INFO nova.virt.block_device [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attempting to driver detach volume 94ee13e7-69c3-41c9-a08a-4e7944339748 from mountpoint /dev/vdb
Nov 22 16:08:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Attempting to detach device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:08:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:08:16 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:08:16 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:08:16 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:08:16 user nova-compute[75734]:   <serial>94ee13e7-69c3-41c9-a08a-4e7944339748</serial>
Nov 22 16:08:16 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:08:16 user nova-compute[75734]: </disk>
Nov 22 16:08:16 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:08:16 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config.
Nov 22 16:08:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:08:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:08:16 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:08:16 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:08:16 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:08:16 user nova-compute[75734]:   <serial>94ee13e7-69c3-41c9-a08a-4e7944339748</serial>
Nov 22 16:08:16 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:08:16 user nova-compute[75734]: </disk>
Nov 22 16:08:16 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:08:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:08:17 user nova-compute[75734]: INFO nova.compute.manager [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Unrescuing
Nov 22 16:08:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:08:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquired lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:08:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updating instance_info_cache with network_info: [{"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Releasing lock "refresh_cache-cee17c90-5f3f-4455-a696-4ba11cd02451" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'flavor' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-dda773cf-fb9e-4ec4-a029-eda210abaa37 req-c2ade3d5-4f9e-4a96-b852-da04616a0080 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dda773cf-fb9e-4ec4-a029-eda210abaa37 req-c2ade3d5-4f9e-4a96-b852-da04616a0080 service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dda773cf-fb9e-4ec4-a029-eda210abaa37 req-c2ade3d5-4f9e-4a96-b852-da04616a0080 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dda773cf-fb9e-4ec4-a029-eda210abaa37 req-c2ade3d5-4f9e-4a96-b852-da04616a0080 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-dda773cf-fb9e-4ec4-a029-eda210abaa37 req-c2ade3d5-4f9e-4a96-b852-da04616a0080 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:18 user nova-compute[75734]: WARNING nova.compute.manager [req-dda773cf-fb9e-4ec4-a029-eda210abaa37 req-c2ade3d5-4f9e-4a96-b852-da04616a0080 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:08:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:19 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance destroyed successfully.
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-223b452c-de9d-4b38-a0f4-ec372bdf3cb1 req-9ef27d17-b8fe-42e7-8789-f84ab96c7add service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-223b452c-de9d-4b38-a0f4-ec372bdf3cb1 req-9ef27d17-b8fe-42e7-8789-f84ab96c7add service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-223b452c-de9d-4b38-a0f4-ec372bdf3cb1 req-9ef27d17-b8fe-42e7-8789-f84ab96c7add service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-223b452c-de9d-4b38-a0f4-ec372bdf3cb1 req-9ef27d17-b8fe-42e7-8789-f84ab96c7add service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-223b452c-de9d-4b38-a0f4-ec372bdf3cb1 req-9ef27d17-b8fe-42e7-8789-f84ab96c7add service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:20 user nova-compute[75734]: WARNING nova.compute.manager [req-223b452c-de9d-4b38-a0f4-ec372bdf3cb1 req-9ef27d17-b8fe-42e7-8789-f84ab96c7add service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state rescued and task_state unrescuing.
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f6cfcdc6-3b48-4382-9837-8064b4619e30 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:22 user nova-compute[75734]: WARNING nova.compute.manager [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state active and task_state None.
Nov 22 16:08:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:22 user nova-compute[75734]: WARNING nova.compute.manager [req-7f4764e7-7de0-4e0c-b34d-a7ae72697cc1 req-10a1d23c-98b3-4afe-8056-2f1fa363a3cb service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state active and task_state None.
Nov 22 16:08:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-changed-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Refreshing instance network info cache due to event network-changed-ef4b670c-25a7-4174-b033-1501fea5852d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:08:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] Acquiring lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:08:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] Acquired lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:08:30 user nova-compute[75734]: DEBUG nova.network.neutron [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Refreshing network info cache for port ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:08:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:31 user nova-compute[75734]: DEBUG nova.network.neutron [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Updated VIF entry in instance network info cache for port ef4b670c-25a7-4174-b033-1501fea5852d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:08:31 user nova-compute[75734]: DEBUG nova.network.neutron [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Updating instance_info_cache with network_info: [{"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:08:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-39603cc5-eb21-4fc7-8a31-ac0ee7130f10 req-4800e3ca-6a00-4d73-9e76-7cf05b9bfc5a service nova] Releasing lock "refresh_cache-044c6387-321b-4616-82ef-d917efb9eaf2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:08:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid 044c6387-321b-4616-82ef-d917efb9eaf2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:33 user nova-compute[75734]: INFO nova.compute.manager [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Attaching volume b81ded2a-e70f-4367-92e1-a153c8a627c9 to /dev/vdb
Nov 22 16:08:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79893df-054f-41dc-aa25-e24e4478c945]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a0c9b4-229c-421e-9275-62d7032b1463]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cfecc1-3400-461f-a8da-dae936790464]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f037799-042e-459a-bb4d-96dc42cf2c54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:08:33 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:08:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[284805a6-a047-4152-910a-be2be556f30d]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:08:33 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Updating existing volume attachment record: 48edd5cf-6ab0-420c-88ed-9e760aac3d78 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:08:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c is timed out.
Nov 22 16:08:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config.
Nov 22 16:08:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvktAxTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:08:36 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5591540-b38a-4191-bb5b-a0c01bb61a9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:08:36 user nova-compute[75734]: No targets found.
Nov 22 16:08:36 user nova-compute[75734]: iSNS:
Nov 22 16:08:36 user nova-compute[75734]: No targets found.
Nov 22 16:08:36 user nova-compute[75734]: STATIC:
Nov 22 16:08:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:08:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:08:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:08:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:08:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:08:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:08:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748
Nov 22 16:08:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:08:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:08:36 user nova-compute[75734]: FIRMWARE:
Nov 22 16:08:36 user nova-compute[75734]: No targets found.
Nov 22 16:08:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:08:36 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:08:36 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa60a72-1456-4fca-94ed-dca0f503e660]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24fb6e3-2a61-4ad4-989f-c20296463a2a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:36 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:36 user nova-compute[75734]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 (non-flash)
Nov 22 16:08:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:36 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:36 user nova-compute[75734]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 (non-flash)
Nov 22 16:08:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc321bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:08:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[45262812-31bf-4f20-9460-42cf6f14d484]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c039c48b-b914-4920-96d7-b96676ea8153]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[960305b9-c105-437f-81a8-a0093d2f44a6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd498b6d-f1a3-4bb7-91de-63391bd7be15]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d870fd-d25a-404c-aa0c-59a62f245834]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5a2241-23c1-4e64-b85b-542cdef11aab]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260]
Nov 22 16:08:37 user nova-compute[75734]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748, portal: 172.16.0.220,3260] successful.
Nov 22 16:08:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94ee13e7-69c3-41c9-a08a-4e7944339748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fdaa68-32f8-4285-82b5-dbcd4dcf11fc]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== disconnect_volume: return (322ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:08:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:08:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f22f76d3-3034-4a15-9cb7-3ddac51e4e86 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.722s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbAXhDTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:08:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:08:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:08:39 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[053c6894-b029-47cf-9a38-13284e656788]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:08:39 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f0b71-38cb-4668-a761-8eaf474b6db1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9] added
Nov 22 16:08:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c203b513-bdb4-4adc-a43c-6c5772987fe9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac4b8d6-8950-47e0-a945-8c5bcdc6d99f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbAXhDTN {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbAXhDTN" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8aace-bb8b-4f5f-bf0a-481d80127bb6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VbAXhDTN'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdef0e6e-d18c-4397-abe7-3ff4e8788308]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98352a7-5ea6-4579-9cc0-790032e45478]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9004c819-621b-4e88-8ea9-a66f57160bd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260]
Nov 22 16:08:40 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260] successful.
Nov 22 16:08:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba65ae85-8a6c-4036-a4fe-02b4c809dd50]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f72199-74dc-491f-b67b-9ba0e9266cab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:40 user nova-compute[75734]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 (non-flash)
Nov 22 16:08:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:08:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:08:40 user nova-compute[75734]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 (non-flash)
Nov 22 16:08:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c935f3a-a530-40d9-b167-273304added1]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbAXhDTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:08:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23735383638313737', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735383638313737', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid 044c6387-321b-4616-82ef-d917efb9eaf2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:08:41 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:08:41 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:08:41 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:08:41 user nova-compute[75734]:   <serial>b81ded2a-e70f-4367-92e1-a153c8a627c9</serial>
Nov 22 16:08:41 user nova-compute[75734]: </disk>
Nov 22 16:08:41 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No VIF found with MAC fa:16:3e:fb:8b:6e, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:08:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb8e3a9e-2135-486a-9c02-b31acffc494c tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.361s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:08:42 user nova-compute[75734]: INFO nova.compute.claims [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Claim successful on node user
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:42 user nova-compute[75734]: INFO nova.compute.manager [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Detaching volume b81ded2a-e70f-4367-92e1-a153c8a627c9
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:08:42 user nova-compute[75734]: INFO nova.virt.block_device [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Attempting to driver detach volume b81ded2a-e70f-4367-92e1-a153c8a627c9 from mountpoint /dev/vdb
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Attempting to detach device vdb from instance 044c6387-321b-4616-82ef-d917efb9eaf2 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:08:42 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:08:42 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:08:42 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:08:42 user nova-compute[75734]:   <serial>b81ded2a-e70f-4367-92e1-a153c8a627c9</serial>
Nov 22 16:08:42 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:08:42 user nova-compute[75734]: </disk>
Nov 22 16:08:42 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:08:42 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully detached device vdb from instance 044c6387-321b-4616-82ef-d917efb9eaf2 from the persistent domain config.
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 044c6387-321b-4616-82ef-d917efb9eaf2 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:08:42 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:08:42 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:08:42 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:08:42 user nova-compute[75734]:   <serial>b81ded2a-e70f-4367-92e1-a153c8a627c9</serial>
Nov 22 16:08:42 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:08:42 user nova-compute[75734]: </disk>
Nov 22 16:08:42 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:08:42 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.policy [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4416aa9b484a609622819875bbd32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f32f21ea574502bb22f0c65e02307c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:08:42 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Creating image(s)
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "/opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "/opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "/opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:42 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 044c6387-321b-4616-82ef-d917efb9eaf2 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk 1073741824" returned: 0 in 0.062s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Successfully created port: 31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Cannot resize image /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Ensure instance console log exists: /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Successfully updated port: 31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "refresh_cache-4feab9cc-6678-49c0-912d-faa72e5e68ca" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquired lock "refresh_cache-4feab9cc-6678-49c0-912d-faa72e5e68ca" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:08:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received event network-changed-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Refreshing instance network info cache due to event network-changed-31eaece0-6f7f-41a3-8b12-70df22408d94. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] Acquiring lock "refresh_cache-4feab9cc-6678-49c0-912d-faa72e5e68ca" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Updating instance_info_cache with network_info: [{"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Releasing lock "refresh_cache-4feab9cc-6678-49c0-912d-faa72e5e68ca" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Instance network_info: |[{"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] Acquired lock "refresh_cache-4feab9cc-6678-49c0-912d-faa72e5e68ca" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.neutron [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Refreshing network info cache for port 31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Start _get_guest_xml network_info=[{"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:08:44 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:08:44 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-879259954',display_name='tempest-VolumesActionsTest-instance-879259954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-879259954',id=30,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f32f21ea574502bb22f0c65e02307c',ramdisk_id='',reservation_id='r-60ocnofg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-233001274',owner_user_name='tempest-VolumesActionsTest-233001274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:08:43Z,user_data=None,user_id='9e4416aa9b484a609622819875bbd32b',uuid=4feab9cc-6678-49c0-912d-faa72e5e68ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converting VIF {"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:99:11,bridge_name='br-int',has_traffic_filtering=True,id=31eaece0-6f7f-41a3-8b12-70df22408d94,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31eaece0-6f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lazy-loading 'pci_devices' on Instance uuid 4feab9cc-6678-49c0-912d-faa72e5e68ca {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:08:44 user nova-compute[75734]:   <uuid>4feab9cc-6678-49c0-912d-faa72e5e68ca</uuid>
Nov 22 16:08:44 user nova-compute[75734]:   <name>instance-0000001e</name>
Nov 22 16:08:44 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:08:44 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:08:44 user nova-compute[75734]:   <metadata>
Nov 22 16:08:44 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:08:44 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:08:44 user nova-compute[75734]:       <nova:name>tempest-VolumesActionsTest-instance-879259954</nova:name>
Nov 22 16:08:44 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:08:44</nova:creationTime>
Nov 22 16:08:44 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:08:44 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:08:44 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:08:44 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:08:44 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:08:44 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:08:44 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:08:44 user nova-compute[75734]:       <nova:owner>
Nov 22 16:08:44 user nova-compute[75734]:         <nova:user uuid="9e4416aa9b484a609622819875bbd32b">tempest-VolumesActionsTest-233001274-project-member</nova:user>
Nov 22 16:08:44 user nova-compute[75734]:         <nova:project uuid="f7f32f21ea574502bb22f0c65e02307c">tempest-VolumesActionsTest-233001274</nova:project>
Nov 22 16:08:44 user nova-compute[75734]:       </nova:owner>
Nov 22 16:08:44 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:08:44 user nova-compute[75734]:       <nova:ports>
Nov 22 16:08:44 user nova-compute[75734]:         <nova:port uuid="31eaece0-6f7f-41a3-8b12-70df22408d94">
Nov 22 16:08:44 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 16:08:44 user nova-compute[75734]:         </nova:port>
Nov 22 16:08:44 user nova-compute[75734]:       </nova:ports>
Nov 22 16:08:44 user nova-compute[75734]:     </nova:instance>
Nov 22 16:08:44 user nova-compute[75734]:   </metadata>
Nov 22 16:08:44 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:08:44 user nova-compute[75734]:     <system>
Nov 22 16:08:44 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:08:44 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:08:44 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:08:44 user nova-compute[75734]:       <entry name="serial">4feab9cc-6678-49c0-912d-faa72e5e68ca</entry>
Nov 22 16:08:44 user nova-compute[75734]:       <entry name="uuid">4feab9cc-6678-49c0-912d-faa72e5e68ca</entry>
Nov 22 16:08:44 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:08:44 user nova-compute[75734]:     </system>
Nov 22 16:08:44 user nova-compute[75734]:   </sysinfo>
Nov 22 16:08:44 user nova-compute[75734]:   <os>
Nov 22 16:08:44 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:08:44 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:08:44 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:08:44 user nova-compute[75734]:   </os>
Nov 22 16:08:44 user nova-compute[75734]:   <features>
Nov 22 16:08:44 user nova-compute[75734]:     <acpi/>
Nov 22 16:08:44 user nova-compute[75734]:     <apic/>
Nov 22 16:08:44 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:08:44 user nova-compute[75734]:   </features>
Nov 22 16:08:44 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:08:44 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:08:44 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:08:44 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:08:44 user nova-compute[75734]:   </clock>
Nov 22 16:08:44 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:08:44 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:08:44 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:08:44 user nova-compute[75734]:   </cpu>
Nov 22 16:08:44 user nova-compute[75734]:   <devices>
Nov 22 16:08:44 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:08:44 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:08:44 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk"/>
Nov 22 16:08:44 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:08:44 user nova-compute[75734]:     </disk>
Nov 22 16:08:44 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:08:44 user nova-compute[75734]:       <mac address="fa:16:3e:14:99:11"/>
Nov 22 16:08:44 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:08:44 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:08:44 user nova-compute[75734]:       <target dev="tap31eaece0-6f"/>
Nov 22 16:08:44 user nova-compute[75734]:     </interface>
Nov 22 16:08:44 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:08:44 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/console.log" append="off"/>
Nov 22 16:08:44 user nova-compute[75734]:     </serial>
Nov 22 16:08:44 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:08:44 user nova-compute[75734]:     <video>
Nov 22 16:08:44 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:08:44 user nova-compute[75734]:     </video>
Nov 22 16:08:44 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:08:44 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:08:44 user nova-compute[75734]:     </rng>
Nov 22 16:08:44 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:08:44 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:08:44 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:08:44 user nova-compute[75734]:     </memballoon>
Nov 22 16:08:44 user nova-compute[75734]:   </devices>
Nov 22 16:08:44 user nova-compute[75734]: </domain>
Nov 22 16:08:44 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-879259954',display_name='tempest-VolumesActionsTest-instance-879259954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-879259954',id=30,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f32f21ea574502bb22f0c65e02307c',ramdisk_id='',reservation_id='r-60ocnofg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-233001274',owner_user_name='tempest-VolumesActionsTest-233001274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:08:43Z,user_data=None,user_id='9e4416aa9b484a609622819875bbd32b',uuid=4feab9cc-6678-49c0-912d-faa72e5e68ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converting VIF {"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:99:11,bridge_name='br-int',has_traffic_filtering=True,id=31eaece0-6f7f-41a3-8b12-70df22408d94,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31eaece0-6f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG os_vif [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:99:11,bridge_name='br-int',has_traffic_filtering=True,id=31eaece0-6f7f-41a3-8b12-70df22408d94,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31eaece0-6f') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4db48e81-da16-5a89-8827-faa1895497ce', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31eaece0-6f, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31eaece0-6f, col_values=(('qos', UUID('076c7431-6299-462e-9f70-9ccc0d646d8e')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31eaece0-6f, col_values=(('external_ids', {'iface-id': '31eaece0-6f7f-41a3-8b12-70df22408d94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:99:11', 'vm-uuid': '4feab9cc-6678-49c0-912d-faa72e5e68ca'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:44 user nova-compute[75734]: INFO os_vif [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:99:11,bridge_name='br-int',has_traffic_filtering=True,id=31eaece0-6f7f-41a3-8b12-70df22408d94,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31eaece0-6f')
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] No VIF found with MAC fa:16:3e:14:99:11, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.neutron [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Updated VIF entry in instance network info cache for port 31eaece0-6f7f-41a3-8b12-70df22408d94. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG nova.network.neutron [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Updating instance_info_cache with network_info: [{"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:08:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-10c63245-e039-4ff7-a8b0-c46038056d6e req-e29c6644-45af-4ac1-8664-9c1200874926 service nova] Releasing lock "refresh_cache-4feab9cc-6678-49c0-912d-faa72e5e68ca" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:08:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-a05a91b3-e6ed-41e4-af33-48147fb8e89c req-e5d6f1f9-0353-41bf-9c0e-3000a0f06f36 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received event network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a05a91b3-e6ed-41e4-af33-48147fb8e89c req-e5d6f1f9-0353-41bf-9c0e-3000a0f06f36 service nova] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a05a91b3-e6ed-41e4-af33-48147fb8e89c req-e5d6f1f9-0353-41bf-9c0e-3000a0f06f36 service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a05a91b3-e6ed-41e4-af33-48147fb8e89c req-e5d6f1f9-0353-41bf-9c0e-3000a0f06f36 service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG nova.compute.manager [req-a05a91b3-e6ed-41e4-af33-48147fb8e89c req-e5d6f1f9-0353-41bf-9c0e-3000a0f06f36 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] No waiting events found dispatching network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:46 user nova-compute[75734]: WARNING nova.compute.manager [req-a05a91b3-e6ed-41e4-af33-48147fb8e89c req-e5d6f1f9-0353-41bf-9c0e-3000a0f06f36 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received unexpected event network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 for instance with vm_state building and task_state spawning.
Nov 22 16:08:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:08:48 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Instance spawned successfully.
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:08:48 user nova-compute[75734]: INFO nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-34ab52a5-279d-4aeb-8c93-9dcdc0f47d47 req-d86f9858-d005-4df0-a3b5-d586520a2aa2 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received event network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-34ab52a5-279d-4aeb-8c93-9dcdc0f47d47 req-d86f9858-d005-4df0-a3b5-d586520a2aa2 service nova] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-34ab52a5-279d-4aeb-8c93-9dcdc0f47d47 req-d86f9858-d005-4df0-a3b5-d586520a2aa2 service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-34ab52a5-279d-4aeb-8c93-9dcdc0f47d47 req-d86f9858-d005-4df0-a3b5-d586520a2aa2 service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:48 user nova-compute[75734]: DEBUG nova.compute.manager [req-34ab52a5-279d-4aeb-8c93-9dcdc0f47d47 req-d86f9858-d005-4df0-a3b5-d586520a2aa2 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] No waiting events found dispatching network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:48 user nova-compute[75734]: WARNING nova.compute.manager [req-34ab52a5-279d-4aeb-8c93-9dcdc0f47d47 req-d86f9858-d005-4df0-a3b5-d586520a2aa2 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received unexpected event network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 for instance with vm_state building and task_state spawning.
Nov 22 16:08:48 user nova-compute[75734]: INFO nova.compute.manager [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Took 6.27 seconds to build instance.
Nov 22 16:08:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b1882cb0-08de-4668-b607-61f10f8468ed tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.373s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing instance network info cache due to event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:08:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] Acquiring lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:08:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] Acquired lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:08:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updated VIF entry in instance network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f0ac8741-e125-4fc7-9f0d-fcbb5c516d74 req-bf9a7f89-9fa5-4c8b-8409-eca2f8c42170 service nova] Releasing lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:08:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:56 user nova-compute[75734]: INFO nova.compute.manager [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Shelving
Nov 22 16:08:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-523e2ceb-0463-4fa8-b4ac-64eae4304694 req-85117cab-7a6d-48c6-ae4e-6ac4fb59a266 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-unplugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-523e2ceb-0463-4fa8-b4ac-64eae4304694 req-85117cab-7a6d-48c6-ae4e-6ac4fb59a266 service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-523e2ceb-0463-4fa8-b4ac-64eae4304694 req-85117cab-7a6d-48c6-ae4e-6ac4fb59a266 service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-523e2ceb-0463-4fa8-b4ac-64eae4304694 req-85117cab-7a6d-48c6-ae4e-6ac4fb59a266 service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-523e2ceb-0463-4fa8-b4ac-64eae4304694 req-85117cab-7a6d-48c6-ae4e-6ac4fb59a266 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-unplugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:56 user nova-compute[75734]: WARNING nova.compute.manager [req-523e2ceb-0463-4fa8-b4ac-64eae4304694 req-85117cab-7a6d-48c6-ae4e-6ac4fb59a266 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received unexpected event network-vif-unplugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with vm_state active and task_state shelving.
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:56 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:08:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance destroyed successfully.
Nov 22 16:08:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Beginning cold snapshot process
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk /opt/stack/data/nova/instances/snapshots/tmpbnluh8u_/63f4688edf344a1e98a8053494195e9f {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk /opt/stack/data/nova/instances/snapshots/tmpbnluh8u_/63f4688edf344a1e98a8053494195e9f" returned: 0 in 0.759s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:57 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Snapshot extracted, beginning image upload
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e8e8966-b6e4-4ac5-be36-9f31315da175 req-588c03fa-0e02-45a1-8cda-ecc493e0597f service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e8e8966-b6e4-4ac5-be36-9f31315da175 req-588c03fa-0e02-45a1-8cda-ecc493e0597f service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e8e8966-b6e4-4ac5-be36-9f31315da175 req-588c03fa-0e02-45a1-8cda-ecc493e0597f service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e8e8966-b6e4-4ac5-be36-9f31315da175 req-588c03fa-0e02-45a1-8cda-ecc493e0597f service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e8e8966-b6e4-4ac5-be36-9f31315da175 req-588c03fa-0e02-45a1-8cda-ecc493e0597f service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:08:58 user nova-compute[75734]: WARNING nova.compute.manager [req-9e8e8966-b6e4-4ac5-be36-9f31315da175 req-588c03fa-0e02-45a1-8cda-ecc493e0597f service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received unexpected event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:08:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Snapshot image upload complete
Nov 22 16:09:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:00 user nova-compute[75734]: INFO nova.compute.manager [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Shelve offloading
Nov 22 16:09:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance destroyed successfully.
Nov 22 16:09:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquired lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Releasing lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:01 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:09:01 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:09:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7714MB free_disk=24.824790954589844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 90daf829-e4b2-4f46-a915-d2374bb0896c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cee17c90-5f3f-4455-a696-4ba11cd02451 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 044c6387-321b-4616-82ef-d917efb9eaf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 4feab9cc-6678-49c0-912d-faa72e5e68ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:09:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance destroyed successfully.
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'resources' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620964655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620964655',id=28,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmRWp0lXL5zod5s9sYt+qGZu5jWt0PCTA0Lz99UUZtBPolfaBx/0PgEMrfmNx63spio9CBxImcNyZ9sgtuvAJVMhrZSPXwEbGhUbTuC49SxVzf9SuCFPgZ69Y7Qjw8RA==',key_name='tempest-keypair-1677415622',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-dgsvht2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member',shelved_at='2023-11-22T16:09:00.411857',shelved_host='user',shelved_image_id='53bedd26-899e-427b-a075-d834457c04c1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=0bb36614-4020-4eb5-81b3-f8e9a5f43541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG os_vif [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5d05c23-c6, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing instance network info cache due to event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] Acquiring lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] Acquired lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.network.neutron [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0658179e-c9d5-495d-a4b0-fc859e04ebec) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:02 user nova-compute[75734]: INFO os_vif [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6')
Nov 22 16:09:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Deleting instance files /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541_del
Nov 22 16:09:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Deletion of /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541_del complete
Nov 22 16:09:02 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Deleted allocations for instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541
Nov 22 16:09:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.042s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.287s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:02 user nova-compute[75734]: DEBUG nova.objects.base [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<0bb36614-4020-4eb5-81b3-f8e9a5f43541> lazy-loaded attributes: resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG nova.network.neutron [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updated VIF entry in instance network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG nova.network.neutron [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cd141346-b80d-4c9a-b668-2db9b8e90ec4 req-4bfa6ce3-92dd-4528-9bc8-01948eba0edc service nova] Releasing lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:09:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 044c6387-321b-4616-82ef-d917efb9eaf2 is timed out.
Nov 22 16:09:03 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully detached device vdb from instance 044c6387-321b-4616-82ef-d917efb9eaf2 from the live domain config.
Nov 22 16:09:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbAXhDTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:03 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0e79b6-a8c0-4c0b-b648-5ca3573cedfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:09:03 user nova-compute[75734]: No targets found.
Nov 22 16:09:03 user nova-compute[75734]: iSNS:
Nov 22 16:09:03 user nova-compute[75734]: No targets found.
Nov 22 16:09:03 user nova-compute[75734]: STATIC:
Nov 22 16:09:03 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:09:03 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:03 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:03 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:09:03 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:03 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:03 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9
Nov 22 16:09:03 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:03 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:03 user nova-compute[75734]: FIRMWARE:
Nov 22 16:09:03 user nova-compute[75734]: No targets found.
Nov 22 16:09:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:09:03 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:09:03 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[937137b9-31d7-4873-909a-d584a2b60c86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[950900a4-83dd-4b51-8bb3-0db6c8e1d0c8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:03 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:03 user nova-compute[75734]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 (non-flash)
Nov 22 16:09:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:03 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:03 user nova-compute[75734]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 (non-flash)
Nov 22 16:09:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc3d5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e06e1-c3f9-499b-92e2-4041008553c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[df277934-3317-43dd-8ddd-ecf043bac0dd]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acaa627-852c-4972-9b54-cb0b347a53be]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f857240b-ea63-432e-8085-f23dc4a15efe]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a75574-454f-4050-944b-b66a296003a1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0853810-b07e-4d11-ba0d-46b154921bf4]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260]
Nov 22 16:09:03 user nova-compute[75734]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9, portal: 172.16.0.220,3260] successful.
Nov 22 16:09:03 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81ded2a-e70f-4367-92e1-a153c8a627c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40cbfa0-8c98-4858-9d26-5f4cd4dd4401]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== disconnect_volume: return (366ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d8b0275-ef91-4588-b3e7-a8866813c763 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.300s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG nova.objects.instance [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid 044c6387-321b-4616-82ef-d917efb9eaf2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating instance_info_cache with network_info: [{"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-59ee4a0f-6eec-4e5f-a5f8-e1036f03bdbe tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.998s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-635ef0b9-e96c-4d0d-8f62-4382ad2813b8" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:09:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:08 user nova-compute[75734]: INFO nova.compute.manager [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Terminating instance
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-f08f4cd5-b0e0-4346-8a6c-80aca0fc8740 req-43aab508-e395-4bfe-918c-d99fa0023c5e service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-unplugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f08f4cd5-b0e0-4346-8a6c-80aca0fc8740 req-43aab508-e395-4bfe-918c-d99fa0023c5e service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f08f4cd5-b0e0-4346-8a6c-80aca0fc8740 req-43aab508-e395-4bfe-918c-d99fa0023c5e service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f08f4cd5-b0e0-4346-8a6c-80aca0fc8740 req-43aab508-e395-4bfe-918c-d99fa0023c5e service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-f08f4cd5-b0e0-4346-8a6c-80aca0fc8740 req-43aab508-e395-4bfe-918c-d99fa0023c5e service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-unplugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-f08f4cd5-b0e0-4346-8a6c-80aca0fc8740 req-43aab508-e395-4bfe-918c-d99fa0023c5e service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-unplugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Instance destroyed successfully.
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.objects.instance [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'resources' on Instance uuid c9ec4e5a-a31e-470e-9d8b-db2ac4fef115 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1560752947',display_name='tempest-ServerRescueNegativeTestJSON-server-1560752947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1560752947',id=2,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-cfwznl3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:54:58Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=c9ec4e5a-a31e-470e-9d8b-db2ac4fef115,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "address": "fa:16:3e:fc:ba:b4", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3cf56e1-e4", "ovs_interfaceid": "c3cf56e1-e41c-4bfc-919e-e25bc713c512", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG os_vif [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3cf56e1-e4, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5658fbe-1f60-4369-bbe2-10698cb680d6) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:08 user nova-compute[75734]: INFO os_vif [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:ba:b4,bridge_name='br-int',has_traffic_filtering=True,id=c3cf56e1-e41c-4bfc-919e-e25bc713c512,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3cf56e1-e4')
Nov 22 16:09:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Deleting instance files /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115_del
Nov 22 16:09:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Deletion of /opt/stack/data/nova/instances/c9ec4e5a-a31e-470e-9d8b-db2ac4fef115_del complete
Nov 22 16:09:08 user nova-compute[75734]: INFO nova.compute.manager [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 16:09:08 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:09:08 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:09 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Took 0.42 seconds to deallocate network for instance.
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:09 user nova-compute[75734]: INFO nova.compute.manager [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attaching volume 4fb88f17-b425-474d-a3a2-0fe93db70ed7 to /dev/vdb
Nov 22 16:09:09 user nova-compute[75734]: DEBUG os_brick.utils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6579ebb7-9d5d-4841-bb91-87e5f3a372fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[697c857f-a02b-4d24-941d-217552e41139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c71a14-8d47-470c-bb95-ef3728a2f8a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3dcfcb-7533-48c8-944a-c6f1570a455e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:09 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c9542f-ec2e-4a17-9d21-c3c83979d8ed]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG os_brick.utils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:09 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating existing volume attachment record: 8b167682-f8cd-4f2f-b226-2d698999e160 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:09:09 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Deleted allocations for instance c9ec4e5a-a31e-470e-9d8b-db2ac4fef115
Nov 22 16:09:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d330da2c-a326-41dc-baa9-abb601d56ec3 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.990s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-62f5dda9-cbcd-42c0-a809-ea00235b3bf6 req-9f9ca6c6-895e-4358-81b3-aac7582b35c3 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-62f5dda9-cbcd-42c0-a809-ea00235b3bf6 req-9f9ca6c6-895e-4358-81b3-aac7582b35c3 service nova] Acquiring lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-62f5dda9-cbcd-42c0-a809-ea00235b3bf6 req-9f9ca6c6-895e-4358-81b3-aac7582b35c3 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-62f5dda9-cbcd-42c0-a809-ea00235b3bf6 req-9f9ca6c6-895e-4358-81b3-aac7582b35c3 service nova] Lock "c9ec4e5a-a31e-470e-9d8b-db2ac4fef115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-62f5dda9-cbcd-42c0-a809-ea00235b3bf6 req-9f9ca6c6-895e-4358-81b3-aac7582b35c3 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] No waiting events found dispatching network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:09:10 user nova-compute[75734]: WARNING nova.compute.manager [req-62f5dda9-cbcd-42c0-a809-ea00235b3bf6 req-9f9ca6c6-895e-4358-81b3-aac7582b35c3 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received unexpected event network-vif-plugged-c3cf56e1-e41c-4bfc-919e-e25bc713c512 for instance with vm_state deleted and task_state None.
Nov 22 16:09:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-62f5dda9-cbcd-42c0-a809-ea00235b3bf6 req-9f9ca6c6-895e-4358-81b3-aac7582b35c3 service nova] [instance: c9ec4e5a-a31e-470e-9d8b-db2ac4fef115] Received event network-vif-deleted-c3cf56e1-e41c-4bfc-919e-e25bc713c512 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpWlEuzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:15 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:15 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:15 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:09:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d9fc7c-08fd-4f4b-96c2-fa997bab1eb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:09:15 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[65955965-55e4-459c-a8ca-c4b6111b99b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7] added
Nov 22 16:09:15 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4494a3f-7a4d-419a-9cd0-bf9ed87113ad]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa99d383-41dd-4102-bdb7-898b28a984f4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpWlEuzP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpWlEuzP" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9bd5fc-7dae-4f4c-be10-45b1f263c1b9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IpWlEuzP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b5b6d2-840c-4277-bacb-93ad80dd9e26]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[605826d7-1a04-4573-89e9-58c3282bfa8b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:16 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:16 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[40271add-027f-4467-b703-b7aac372ea6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260]
Nov 22 16:09:16 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260] successful.
Nov 22 16:09:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a564d4f-34dc-42e4-8595-06fe1d00bfa5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb8c7f3-e336-4472-9aa3-c65e8552badf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:16 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:16 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:16 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:16 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db5bf9-42c8-4d94-9398-617457ebe74f]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpWlEuzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:09:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23237623732313265', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237623732313265', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG nova.objects.instance [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:09:17 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:17 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:09:17 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:09:17 user nova-compute[75734]:   <serial>4fb88f17-b425-474d-a3a2-0fe93db70ed7</serial>
Nov 22 16:09:17 user nova-compute[75734]: </disk>
Nov 22 16:09:17 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] No VIF found with MAC fa:16:3e:de:13:28, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:09:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-651f2023-c211-4dd8-b786-dae581a8d9b3 tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.147s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:19 user nova-compute[75734]: INFO nova.compute.manager [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Detaching volume 4fb88f17-b425-474d-a3a2-0fe93db70ed7
Nov 22 16:09:19 user nova-compute[75734]: INFO nova.virt.block_device [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Attempting to driver detach volume 4fb88f17-b425-474d-a3a2-0fe93db70ed7 from mountpoint /dev/vdb
Nov 22 16:09:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Attempting to detach device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:09:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:09:19 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:19 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:09:19 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:09:19 user nova-compute[75734]:   <serial>4fb88f17-b425-474d-a3a2-0fe93db70ed7</serial>
Nov 22 16:09:19 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:09:19 user nova-compute[75734]: </disk>
Nov 22 16:09:19 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:09:19 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the persistent domain config.
Nov 22 16:09:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:09:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:09:19 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:19 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:09:19 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:09:19 user nova-compute[75734]:   <serial>4fb88f17-b425-474d-a3a2-0fe93db70ed7</serial>
Nov 22 16:09:19 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:09:19 user nova-compute[75734]: </disk>
Nov 22 16:09:19 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:09:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:09:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-changed-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Refreshing instance network info cache due to event network-changed-6def8f4d-d8e9-4b33-813e-53ab26748d30. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:09:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] Acquiring lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:09:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] Acquired lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:09:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Refreshing network info cache for port 6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updated VIF entry in instance network info cache for port 6def8f4d-d8e9-4b33-813e-53ab26748d30. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updating instance_info_cache with network_info: [{"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b18727ec-2fa8-4d7b-9151-d441eaa18e5a req-49e2839c-415d-487b-bfbc-a81c9737b90f service nova] Releasing lock "refresh_cache-82a9e313-f7b9-4288-8fa7-0b8d55a70957" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'flavor' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:26 user nova-compute[75734]: INFO nova.compute.manager [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Attaching volume e7e83999-fe9e-449b-a62a-01a353377bfe to /dev/vdb
Nov 22 16:09:26 user nova-compute[75734]: DEBUG os_brick.utils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c6867-375a-4375-9ea9-7ba0c6a884e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1692c5-e8df-45e2-9f52-f9a221827c67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e477c2-12a3-44ee-b175-d84d7a81e00d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7f04cc-2b9a-4507-a478-234feda69500]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:26 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:09:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ddd3f2-87d7-41b5-a919-81d419c67222]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG os_brick.utils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:26 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updating existing volume attachment record: e242cfd6-6ce1-4e0b-ba06-ba216295e34f {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:09:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:09:32 user nova-compute[75734]: INFO nova.compute.claims [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Claim successful on node user
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:32 user nova-compute[75734]: INFO nova.compute.manager [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Terminating instance
Nov 22 16:09:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-683c2b97-ce21-4e62-96b4-cd1770f5a6d9 req-c86aa197-3774-4e1d-b6c5-a308438e5bad service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-vif-unplugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-683c2b97-ce21-4e62-96b4-cd1770f5a6d9 req-c86aa197-3774-4e1d-b6c5-a308438e5bad service nova] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-683c2b97-ce21-4e62-96b4-cd1770f5a6d9 req-c86aa197-3774-4e1d-b6c5-a308438e5bad service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-683c2b97-ce21-4e62-96b4-cd1770f5a6d9 req-c86aa197-3774-4e1d-b6c5-a308438e5bad service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-683c2b97-ce21-4e62-96b4-cd1770f5a6d9 req-c86aa197-3774-4e1d-b6c5-a308438e5bad service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] No waiting events found dispatching network-vif-unplugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-683c2b97-ce21-4e62-96b4-cd1770f5a6d9 req-c86aa197-3774-4e1d-b6c5-a308438e5bad service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-vif-unplugged-ef4b670c-25a7-4174-b033-1501fea5852d for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:09:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: INFO nova.virt.block_device [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Booting with volume 65d80c36-68c3-46a2-8b5c-ff90cf51ea7b at /dev/vda
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.policy [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9891b862488466e8e46427bbd19f742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82865952d35349ffa829cf563d829fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c33b22-de17-4ef8-8c60-d9ebd7b0399c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viKZBzYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:33 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4031944-f9a6-4c68-a3cc-5022a8ba111f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3772547-58bd-47fe-a3f8-8f8a9fd3a98f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58de26b-313c-45c0-b0aa-93b6905018b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:09:33 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a9ad8-0768-47f1-ae91-4926c52a6a5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4c8040-5dff-4e26-afba-f72c1d04a68d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe] added
Nov 22 16:09:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:33 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9e3db1-1145-466f-94ae-2c65a798c857]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating existing volume attachment record: 919f8825-9c74-46a2-a3c0-02afd29b949d {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:09:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Instance destroyed successfully.
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12da2d8-be09-45de-b768-a9a3d5a646bf]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'resources' on Instance uuid 044c6387-321b-4616-82ef-d917efb9eaf2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1382496233',display_name='tempest-AttachVolumeNegativeTest-server-1382496233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1382496233',id=27,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO76ypbUpec2EfCce4ils9/NHOqCW/MkHkdmDtgYETjmO/iVIGMUhgwER3tVyMhn3OMcN2V9aoIPrwbn38p4uWE0tL+lGhTpKKm09fVhwjsC1f7GuVw++GrOjN8OEGHIKA==',key_name='tempest-keypair-1706036565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-xqsck0bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=044c6387-321b-4616-82ef-d917efb9eaf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "ef4b670c-25a7-4174-b033-1501fea5852d", "address": "fa:16:3e:fb:8b:6e", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4b670c-25", "ovs_interfaceid": "ef4b670c-25a7-4174-b033-1501fea5852d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:8b:6e,bridge_name='br-int',has_traffic_filtering=True,id=ef4b670c-25a7-4174-b033-1501fea5852d,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4b670c-25') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_vif [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:8b:6e,bridge_name='br-int',has_traffic_filtering=True,id=ef4b670c-25a7-4174-b033-1501fea5852d,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4b670c-25') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c5868-fdec-4490-bc6b-704fbe0dab7d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef4b670c-25, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viKZBzYn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03af87e0-bc2c-4ded-8da0-97a915381a2f) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viKZBzYn" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[86834c2d-fe68-4ad5-b3bc-21d50b4415c7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'viKZBzYn'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: INFO os_vif [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:8b:6e,bridge_name='br-int',has_traffic_filtering=True,id=ef4b670c-25a7-4174-b033-1501fea5852d,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4b670c-25')
Nov 22 16:09:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Deleting instance files /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2_del
Nov 22 16:09:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Deletion of /opt/stack/data/nova/instances/044c6387-321b-4616-82ef-d917efb9eaf2_del complete
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2208af90-6eef-4d46-aac8-3954c3f262a4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[43762ef4-801d-4276-b227-2e8290aeb34a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: INFO nova.compute.manager [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac8d1b-cf63-49a4-8cda-4217d3a23984]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260]
Nov 22 16:09:33 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260] successful.
Nov 22 16:09:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6121a-e5f5-4241-b817-bb87033f06b5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[380f239e-cd2e-4bca-b079-9f60e76852b5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:33 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1851da-fdd5-40f5-a6fe-d6d83ea22663]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:09:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viKZBzYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:09:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Successfully created port: c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:09:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26335313365386137', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335313365386137', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:09:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'flavor' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:34 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:35 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Took 1.18 seconds to deallocate network for instance.
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:09:35 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:35 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:09:35 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:09:35 user nova-compute[75734]:   <serial>e7e83999-fe9e-449b-a62a-01a353377bfe</serial>
Nov 22 16:09:35 user nova-compute[75734]: </disk>
Nov 22 16:09:35 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-b0429682-5212-46b6-a731-bdfb8ddd802b req-6ed5ae2f-6197-4480-8fa2-482ad1ad90cb service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-vif-deleted-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Successfully updated port: c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-f71fa1f4-1c70-45f7-8a91-cbd7bc700933 req-8afa6b8d-8238-42ff-94e4-f98c83635728 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received event network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f71fa1f4-1c70-45f7-8a91-cbd7bc700933 req-8afa6b8d-8238-42ff-94e4-f98c83635728 service nova] Acquiring lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f71fa1f4-1c70-45f7-8a91-cbd7bc700933 req-8afa6b8d-8238-42ff-94e4-f98c83635728 service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f71fa1f4-1c70-45f7-8a91-cbd7bc700933 req-8afa6b8d-8238-42ff-94e4-f98c83635728 service nova] Lock "044c6387-321b-4616-82ef-d917efb9eaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-f71fa1f4-1c70-45f7-8a91-cbd7bc700933 req-8afa6b8d-8238-42ff-94e4-f98c83635728 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] No waiting events found dispatching network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:09:35 user nova-compute[75734]: WARNING nova.compute.manager [req-f71fa1f4-1c70-45f7-8a91-cbd7bc700933 req-8afa6b8d-8238-42ff-94e4-f98c83635728 service nova] [instance: 044c6387-321b-4616-82ef-d917efb9eaf2] Received unexpected event network-vif-plugged-ef4b670c-25a7-4174-b033-1501fea5852d for instance with vm_state deleted and task_state None.
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquired lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:35 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Deleted allocations for instance 044c6387-321b-4616-82ef-d917efb9eaf2
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No VIF found with MAC fa:16:3e:04:19:9e, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6a3c4833-147a-43f9-84a9-4cda0f468626 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "044c6387-321b-4616-82ef-d917efb9eaf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.723s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0df07f8c-59cf-4705-acbe-26c75918c92d tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.023s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Releasing lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:09:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance network_info: |[{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:09:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-changed-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Refreshing instance network info cache due to event network-changed-c2ad5c36-9639-489d-8106-02c283822b7a. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] Acquiring lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] Acquired lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Refreshing network info cache for port c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updated VIF entry in instance network info cache for port c2ad5c36-9639-489d-8106-02c283822b7a. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e11c69c-3720-43b0-ab37-5ffacda56772 req-366e764c-41c6-4b45-bafb-de50270aefb9 service nova] Releasing lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:09:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'flavor' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:39 user nova-compute[75734]: INFO nova.compute.manager [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Attaching volume e20131c6-c77a-41f8-b0dd-82070dc5e395 to /dev/vdc
Nov 22 16:09:39 user nova-compute[75734]: DEBUG os_brick.utils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[68370f3b-3016-467c-9ab3-854e390d283b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aea0e6-11da-4c9f-94c9-0a4ccccdb962]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb965c-6c08-4d03-849f-691d1994e26c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[651321b2-6fb9-4aae-9dd1-eeca2e4ac1e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:09:39 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:09:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf8e5b3-c3be-4c5b-8b13-84dccdbc99b9]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG os_brick.utils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:39 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updating existing volume attachment record: fb0c37c3-2163-488d-b3f7-da2edd125384 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:09:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Creating image(s)
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Ensure instance console log exists: /opt/stack/data/nova/instances/6252f7b5-0458-42d4-8747-dfe425918dec/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Start _get_guest_xml network_info=[{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '919f8825-9c74-46a2-a3c0-02afd29b949d', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6252f7b5-0458-42d4-8747-dfe425918dec', 'attached_at': '', 'detached_at': '', 'volume_id': '65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'serial': '65d80c36-68c3-46a2-8b5c-ff90cf51ea7b'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:09:40 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:09:40 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:40 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:40 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:40 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:09:40 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90daf829-e4b2-4f46-a915-d2374bb0896c is timed out.
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully detached device vdb from instance 90daf829-e4b2-4f46-a915-d2374bb0896c from the live domain config.
Nov 22 16:09:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpWlEuzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:40 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c3a61-868b-4ba5-bb58-061230465f95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:09:40 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2dff7c-3532-4e81-809e-a38b79d91e24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b] added
Nov 22 16:09:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2014a8ea-334e-4df5-a3ca-f7cd2449b649]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[939996a1-5d4a-4b57-a5c8-644cf26a93f7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdfTHDor {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdfTHDor" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f138f1-b049-4e6b-9c67-65f473bfb3f9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdfTHDor'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8069ae51-4ec3-46aa-98bd-84c4076ee6ed]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d58581-e231-4ecf-93db-c180226ec1e1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fb27c-972e-413b-b669-1a714f5f56da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]
Nov 22 16:09:40 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.
Nov 22 16:09:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e26fde0-56e4-4e0f-9f6b-46b90a0bef8b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[693db4ac-8eb2-4174-a594-14b8f1f1ca73]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:40 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be55d56-a4e7-4263-b2c5-898a56438d42]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26533363733343637', 'path': '/dev/sde'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533363733343637', 'path': '/dev/sde'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.309s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1617189345',display_name='tempest-ServerActionsTestOtherA-server-1617189345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1617189345',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-jv06e6lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:09:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=6252f7b5-0458-42d4-8747-dfe425918dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.objects.instance [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'pci_devices' on Instance uuid 6252f7b5-0458-42d4-8747-dfe425918dec {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec2c9be-dc5e-42ad-a202-f64edb0252e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:09:41 user nova-compute[75734]: No targets found.
Nov 22 16:09:41 user nova-compute[75734]: iSNS:
Nov 22 16:09:41 user nova-compute[75734]: No targets found.
Nov 22 16:09:41 user nova-compute[75734]: STATIC:
Nov 22 16:09:41 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe
Nov 22 16:09:41 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:41 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:41 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:09:41 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:41 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:41 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7
Nov 22 16:09:41 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:41 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:41 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:09:41 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:41 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:41 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:09:41 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:09:41 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:09:41 user nova-compute[75734]: FIRMWARE:
Nov 22 16:09:41 user nova-compute[75734]: No targets found.
Nov 22 16:09:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:09:41 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:09:41 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:09:41 user nova-compute[75734]:   <uuid>6252f7b5-0458-42d4-8747-dfe425918dec</uuid>
Nov 22 16:09:41 user nova-compute[75734]:   <name>instance-0000001f</name>
Nov 22 16:09:41 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:09:41 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:09:41 user nova-compute[75734]:   <metadata>
Nov 22 16:09:41 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:09:41 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:09:41 user nova-compute[75734]:       <nova:name>tempest-ServerActionsTestOtherA-server-1617189345</nova:name>
Nov 22 16:09:41 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:09:40</nova:creationTime>
Nov 22 16:09:41 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:09:41 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:09:41 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:09:41 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:09:41 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:09:41 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:09:41 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:09:41 user nova-compute[75734]:       <nova:owner>
Nov 22 16:09:41 user nova-compute[75734]:         <nova:user uuid="e9891b862488466e8e46427bbd19f742">tempest-ServerActionsTestOtherA-2146149591-project-member</nova:user>
Nov 22 16:09:41 user nova-compute[75734]:         <nova:project uuid="82865952d35349ffa829cf563d829fbe">tempest-ServerActionsTestOtherA-2146149591</nova:project>
Nov 22 16:09:41 user nova-compute[75734]:       </nova:owner>
Nov 22 16:09:41 user nova-compute[75734]:       <nova:ports>
Nov 22 16:09:41 user nova-compute[75734]:         <nova:port uuid="c2ad5c36-9639-489d-8106-02c283822b7a">
Nov 22 16:09:41 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 16:09:41 user nova-compute[75734]:         </nova:port>
Nov 22 16:09:41 user nova-compute[75734]:       </nova:ports>
Nov 22 16:09:41 user nova-compute[75734]:     </nova:instance>
Nov 22 16:09:41 user nova-compute[75734]:   </metadata>
Nov 22 16:09:41 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:09:41 user nova-compute[75734]:     <system>
Nov 22 16:09:41 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:09:41 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:09:41 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:09:41 user nova-compute[75734]:       <entry name="serial">6252f7b5-0458-42d4-8747-dfe425918dec</entry>
Nov 22 16:09:41 user nova-compute[75734]:       <entry name="uuid">6252f7b5-0458-42d4-8747-dfe425918dec</entry>
Nov 22 16:09:41 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:09:41 user nova-compute[75734]:     </system>
Nov 22 16:09:41 user nova-compute[75734]:   </sysinfo>
Nov 22 16:09:41 user nova-compute[75734]:   <os>
Nov 22 16:09:41 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:09:41 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:09:41 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:09:41 user nova-compute[75734]:   </os>
Nov 22 16:09:41 user nova-compute[75734]:   <features>
Nov 22 16:09:41 user nova-compute[75734]:     <acpi/>
Nov 22 16:09:41 user nova-compute[75734]:     <apic/>
Nov 22 16:09:41 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:09:41 user nova-compute[75734]:   </features>
Nov 22 16:09:41 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:09:41 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:09:41 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:09:41 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:09:41 user nova-compute[75734]:   </clock>
Nov 22 16:09:41 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:09:41 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:09:41 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:09:41 user nova-compute[75734]:   </cpu>
Nov 22 16:09:41 user nova-compute[75734]:   <devices>
Nov 22 16:09:41 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:09:41 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:41 user nova-compute[75734]:       <source dev="/dev/sde"/>
Nov 22 16:09:41 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:09:41 user nova-compute[75734]:       <serial>65d80c36-68c3-46a2-8b5c-ff90cf51ea7b</serial>
Nov 22 16:09:41 user nova-compute[75734]:     </disk>
Nov 22 16:09:41 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:09:41 user nova-compute[75734]:       <mac address="fa:16:3e:23:0e:32"/>
Nov 22 16:09:41 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:09:41 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:09:41 user nova-compute[75734]:       <target dev="tapc2ad5c36-96"/>
Nov 22 16:09:41 user nova-compute[75734]:     </interface>
Nov 22 16:09:41 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:09:41 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/6252f7b5-0458-42d4-8747-dfe425918dec/console.log" append="off"/>
Nov 22 16:09:41 user nova-compute[75734]:     </serial>
Nov 22 16:09:41 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:09:41 user nova-compute[75734]:     <video>
Nov 22 16:09:41 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:09:41 user nova-compute[75734]:     </video>
Nov 22 16:09:41 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:09:41 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:09:41 user nova-compute[75734]:     </rng>
Nov 22 16:09:41 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:09:41 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:09:41 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:09:41 user nova-compute[75734]:     </memballoon>
Nov 22 16:09:41 user nova-compute[75734]:   </devices>
Nov 22 16:09:41 user nova-compute[75734]: </domain>
Nov 22 16:09:41 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1617189345',display_name='tempest-ServerActionsTestOtherA-server-1617189345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1617189345',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-jv06e6lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:09:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=6252f7b5-0458-42d4-8747-dfe425918dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_vif [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '261bff1c-3395-5798-9789-190d0941b8ea', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a9b77-5ed2-4e9a-931b-1120a20702d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ad5c36-96, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2ad5c36-96, col_values=(('qos', UUID('9dcd2524-93c6-4f1d-be26-d146bf33a8c6')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2ad5c36-96, col_values=(('external_ids', {'iface-id': 'c2ad5c36-9639-489d-8106-02c283822b7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:0e:32', 'vm-uuid': '6252f7b5-0458-42d4-8747-dfe425918dec'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:41 user nova-compute[75734]: INFO os_vif [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96')
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf708a3-cbdd-4907-abfa-210a25f06586]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:41 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac5ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68bc4a-4253-42dd-958a-92a592e2466c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.045s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[77106783-5e65-420d-8b38-e6dccb89ca2a]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b241a-effd-470c-8d67-1a1e12fdb0e7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No VIF found with MAC fa:16:3e:23:0e:32, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16ed02-2770-4cc1-adc4-490b1fb12c32]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d129f-e8a4-48b4-9d97-e767f979358c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a71c86-863e-424e-a168-331d5f82e5fe]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260]
Nov 22 16:09:41 user nova-compute[75734]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7, portal: 172.16.0.220,3260] successful.
Nov 22 16:09:41 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb88f17-b425-474d-a3a2-0fe93db70ed7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[98216bcc-5040-40c8-8b6d-a15ce3ae07f7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] <== disconnect_volume: return (1671ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:09:42 user nova-compute[75734]: DEBUG nova.objects.instance [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'flavor' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-72ab991b-ecc4-4360-8a0d-ae68f334138c tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.007s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-5c084b41-7e44-4632-b836-fb789a22aaa9 req-c41824a6-b6ef-49cf-90ec-c5978cfe7f73 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5c084b41-7e44-4632-b836-fb789a22aaa9 req-c41824a6-b6ef-49cf-90ec-c5978cfe7f73 service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5c084b41-7e44-4632-b836-fb789a22aaa9 req-c41824a6-b6ef-49cf-90ec-c5978cfe7f73 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5c084b41-7e44-4632-b836-fb789a22aaa9 req-c41824a6-b6ef-49cf-90ec-c5978cfe7f73 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-5c084b41-7e44-4632-b836-fb789a22aaa9 req-c41824a6-b6ef-49cf-90ec-c5978cfe7f73 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:09:43 user nova-compute[75734]: WARNING nova.compute.manager [req-5c084b41-7e44-4632-b836-fb789a22aaa9 req-c41824a6-b6ef-49cf-90ec-c5978cfe7f73 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received unexpected event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with vm_state building and task_state spawning.
Nov 22 16:09:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:09:45 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance spawned successfully.
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:09:45 user nova-compute[75734]: INFO nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-6a57a445-ff60-46b6-9b8c-753f15b82b25 req-b3262fc0-8448-4cb7-be55-e7dec81c6d60 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6a57a445-ff60-46b6-9b8c-753f15b82b25 req-b3262fc0-8448-4cb7-be55-e7dec81c6d60 service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6a57a445-ff60-46b6-9b8c-753f15b82b25 req-b3262fc0-8448-4cb7-be55-e7dec81c6d60 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6a57a445-ff60-46b6-9b8c-753f15b82b25 req-b3262fc0-8448-4cb7-be55-e7dec81c6d60 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-6a57a445-ff60-46b6-9b8c-753f15b82b25 req-b3262fc0-8448-4cb7-be55-e7dec81c6d60 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:09:45 user nova-compute[75734]: WARNING nova.compute.manager [req-6a57a445-ff60-46b6-9b8c-753f15b82b25 req-b3262fc0-8448-4cb7-be55-e7dec81c6d60 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received unexpected event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with vm_state building and task_state spawning.
Nov 22 16:09:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPZXyKcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:09:45 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:45 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:09:45 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[947db6bc-2704-421b-9bde-e6af3b2a7cd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:09:45 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0ee412-74c4-47cb-b315-1efb1d5b12aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395] added
Nov 22 16:09:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: INFO nova.compute.manager [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Took 12.64 seconds to build instance.
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0f7c20-aff9-4456-9566-3c910c4b2561]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4d6fcbb2-ad6c-41a2-a778-914c85acbab3 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.770s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9a27a-1480-4dd6-8dc4-c3706862805f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPZXyKcA {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPZXyKcA" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[62578d49-a5a2-4395-80a2-09eb552303ef]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hPZXyKcA'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[529a206e-a9a1-4310-999c-3df488eb8a57]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be234f-0a45-437a-af42-5bb7eda4847c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c5425-2e50-4e9b-b8ac-e2ac875186c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260]
Nov 22 16:09:45 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260] successful.
Nov 22 16:09:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a0b69-e289-4c59-9726-bad3131e2df5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab12bc1-7123-4c6a-b669-7d522bbcf342]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 (non-flash)
Nov 22 16:09:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:09:45 user nova-compute[75734]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 (non-flash)
Nov 22 16:09:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370da45-fbc9-49bf-af8c-de52275956b4]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:09:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPZXyKcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:09:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:09:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23462613834643836', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:09:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462613834643836', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:09:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'flavor' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:09:46 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:46 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:09:46 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:09:46 user nova-compute[75734]:   <serial>e20131c6-c77a-41f8-b0dd-82070dc5e395</serial>
Nov 22 16:09:46 user nova-compute[75734]: </disk>
Nov 22 16:09:46 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:09:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:09:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] No VIF found with MAC fa:16:3e:04:19:9e, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:09:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-25dab5c1-fd4b-42ac-83a6-9897c4af6122 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.116s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:47 user nova-compute[75734]: INFO nova.compute.manager [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Detaching volume e20131c6-c77a-41f8-b0dd-82070dc5e395
Nov 22 16:09:48 user nova-compute[75734]: INFO nova.virt.block_device [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Attempting to driver detach volume e20131c6-c77a-41f8-b0dd-82070dc5e395 from mountpoint /dev/vdc
Nov 22 16:09:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Attempting to detach device vdc from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:09:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:09:48 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:48 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:09:48 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:09:48 user nova-compute[75734]:   <serial>e20131c6-c77a-41f8-b0dd-82070dc5e395</serial>
Nov 22 16:09:48 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 16:09:48 user nova-compute[75734]: </disk>
Nov 22 16:09:48 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:09:48 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Successfully detached device vdc from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the persistent domain config.
Nov 22 16:09:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:09:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:09:48 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:09:48 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:09:48 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:09:48 user nova-compute[75734]:   <serial>e20131c6-c77a-41f8-b0dd-82070dc5e395</serial>
Nov 22 16:09:48 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 16:09:48 user nova-compute[75734]: </disk>
Nov 22 16:09:48 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:09:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:09:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:09:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:09:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:58 user nova-compute[75734]: INFO nova.compute.manager [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Terminating instance
Nov 22 16:09:58 user nova-compute[75734]: DEBUG nova.compute.manager [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-a3812e85-4e1a-4030-9bcd-4f06211b2589 req-0170838d-9663-4d8d-9cdf-c74472a0a916 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a3812e85-4e1a-4030-9bcd-4f06211b2589 req-0170838d-9663-4d8d-9cdf-c74472a0a916 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a3812e85-4e1a-4030-9bcd-4f06211b2589 req-0170838d-9663-4d8d-9cdf-c74472a0a916 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a3812e85-4e1a-4030-9bcd-4f06211b2589 req-0170838d-9663-4d8d-9cdf-c74472a0a916 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-a3812e85-4e1a-4030-9bcd-4f06211b2589 req-0170838d-9663-4d8d-9cdf-c74472a0a916 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:09:58 user nova-compute[75734]: DEBUG nova.compute.manager [req-a3812e85-4e1a-4030-9bcd-4f06211b2589 req-0170838d-9663-4d8d-9cdf-c74472a0a916 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-unplugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Instance destroyed successfully.
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.objects.instance [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lazy-loading 'resources' on Instance uuid ee07b591-af40-4c95-9d6a-1ffc82eff086 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-124882235',display_name='tempest-ServerRescueNegativeTestJSON-server-124882235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-124882235',id=1,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:57:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='963ad36880484ed59f2b34c64a6e450e',ramdisk_id='',reservation_id='r-dn9irsps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-970419785',owner_user_name='tempest-ServerRescueNegativeTestJSON-970419785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:59:33Z,user_data=None,user_id='ea603e7c80014f17a76fec19b54443c9',uuid=ee07b591-af40-4c95-9d6a-1ffc82eff086,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converting VIF {"id": "e1881bde-e537-452d-b9f1-697dd0638465", "address": "fa:16:3e:99:73:52", "network": {"id": "18b1dc9c-f6be-4cfc-a931-cc13c4d5f428", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-386177598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "963ad36880484ed59f2b34c64a6e450e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1881bde-e5", "ovs_interfaceid": "e1881bde-e537-452d-b9f1-697dd0638465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG os_vif [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1881bde-e5, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7409cacd-4d54-405c-833f-a701fc263a63) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:09:59 user nova-compute[75734]: INFO os_vif [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:73:52,bridge_name='br-int',has_traffic_filtering=True,id=e1881bde-e537-452d-b9f1-697dd0638465,network=Network(18b1dc9c-f6be-4cfc-a931-cc13c4d5f428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1881bde-e5')
Nov 22 16:09:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Deleting instance files /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086_del
Nov 22 16:09:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Deletion of /opt/stack/data/nova/instances/ee07b591-af40-4c95-9d6a-1ffc82eff086_del complete
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:09:59 user nova-compute[75734]: INFO nova.compute.manager [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-5bf583e7-c093-40bc-b67c-1d84bd998776 req-a0429af5-b64e-4548-b87a-197bb4ed4b13 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-deleted-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:09:59 user nova-compute[75734]: INFO nova.compute.manager [req-5bf583e7-c093-40bc-b67c-1d84bd998776 req-a0429af5-b64e-4548-b87a-197bb4ed4b13 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Neutron deleted interface e1881bde-e537-452d-b9f1-697dd0638465; detaching it from the instance and deleting it from the info cache
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.network.neutron [req-5bf583e7-c093-40bc-b67c-1d84bd998776 req-a0429af5-b64e-4548-b87a-197bb4ed4b13 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:09:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=7752MB free_disk=24.820716857910156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:09:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-5bf583e7-c093-40bc-b67c-1d84bd998776 req-a0429af5-b64e-4548-b87a-197bb4ed4b13 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Detach interface failed, port_id=e1881bde-e537-452d-b9f1-697dd0638465, reason: Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:09:59 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Took 0.58 seconds to deallocate network for instance.
Nov 22 16:10:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance ee07b591-af40-4c95-9d6a-1ffc82eff086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 90daf829-e4b2-4f46-a915-d2374bb0896c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cee17c90-5f3f-4455-a696-4ba11cd02451 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 4feab9cc-6678-49c0-912d-faa72e5e68ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 6252f7b5-0458-42d4-8747-dfe425918dec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.423s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:10:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:00 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Deleted allocations for instance ee07b591-af40-4c95-9d6a-1ffc82eff086
Nov 22 16:10:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-852516c5-7e09-4fe0-bb91-ae59c0f4b011 tempest-ServerRescueNegativeTestJSON-970419785 tempest-ServerRescueNegativeTestJSON-970419785-project-member] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.245s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-261cc41c-521b-42ef-b309-5b71c07896a4 req-45986f04-6681-4c72-b84b-2efdf5a659f6 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-261cc41c-521b-42ef-b309-5b71c07896a4 req-45986f04-6681-4c72-b84b-2efdf5a659f6 service nova] Acquiring lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-261cc41c-521b-42ef-b309-5b71c07896a4 req-45986f04-6681-4c72-b84b-2efdf5a659f6 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-261cc41c-521b-42ef-b309-5b71c07896a4 req-45986f04-6681-4c72-b84b-2efdf5a659f6 service nova] Lock "ee07b591-af40-4c95-9d6a-1ffc82eff086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-261cc41c-521b-42ef-b309-5b71c07896a4 req-45986f04-6681-4c72-b84b-2efdf5a659f6 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] No waiting events found dispatching network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:01 user nova-compute[75734]: WARNING nova.compute.manager [req-261cc41c-521b-42ef-b309-5b71c07896a4 req-45986f04-6681-4c72-b84b-2efdf5a659f6 service nova] [instance: ee07b591-af40-4c95-9d6a-1ffc82eff086] Received unexpected event network-vif-plugged-e1881bde-e537-452d-b9f1-697dd0638465 for instance with vm_state deleted and task_state None.
Nov 22 16:10:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:10:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:10:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:10:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:10:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:10:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:10:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 is timed out.
Nov 22 16:10:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Successfully detached device vdc from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the live domain config.
Nov 22 16:10:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPZXyKcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:10:08 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[be458486-3e29-4d2b-906f-f8064cd0aa16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:10:08 user nova-compute[75734]: No targets found.
Nov 22 16:10:08 user nova-compute[75734]: iSNS:
Nov 22 16:10:08 user nova-compute[75734]: No targets found.
Nov 22 16:10:08 user nova-compute[75734]: STATIC:
Nov 22 16:10:08 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe
Nov 22 16:10:08 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:08 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:08 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:10:08 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:08 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:08 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:10:08 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:08 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:08 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:10:08 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:08 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:08 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395
Nov 22 16:10:08 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:08 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:08 user nova-compute[75734]: FIRMWARE:
Nov 22 16:10:08 user nova-compute[75734]: No targets found.
Nov 22 16:10:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:10:08 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:10:08 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b67e6a-e8e9-4f75-8403-5e4db8e0bcd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[84506324-f68b-461e-84ab-3fdd8fd94f61]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 (non-flash)
Nov 22 16:10:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:10:08 user nova-compute[75734]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 (non-flash)
Nov 22 16:10:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac6b1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25f80e2-d73b-4858-b881-d464705af73e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a203699a-edd2-48f7-a49f-68ea6b3b29ce]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c063b-eb81-4b68-85fb-91d5612644f0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d06a82d-b09c-41fb-a454-26d370f40637]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:08 user nova-compute[75734]: INFO nova.compute.manager [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Terminating instance
Nov 22 16:10:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d80731-7bd5-4553-b301-e67088b9151b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a570ca-5f64-4d5d-a74c-02053eddd07f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260]
Nov 22 16:10:08 user nova-compute[75734]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395, portal: 172.16.0.220,3260] successful.
Nov 22 16:10:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e20131c6-c77a-41f8-b0dd-82070dc5e395 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb31b53-1df0-4d35-ab28-bfbc6058f886]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] <== disconnect_volume: return (350ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:10:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-9d6c13f7-b4d8-4958-8d29-6a024b02a206 req-edd62dec-3463-4641-a166-ccdf808a281e service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9d6c13f7-b4d8-4958-8d29-6a024b02a206 req-edd62dec-3463-4641-a166-ccdf808a281e service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9d6c13f7-b4d8-4958-8d29-6a024b02a206 req-edd62dec-3463-4641-a166-ccdf808a281e service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9d6c13f7-b4d8-4958-8d29-6a024b02a206 req-edd62dec-3463-4641-a166-ccdf808a281e service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-9d6c13f7-b4d8-4958-8d29-6a024b02a206 req-edd62dec-3463-4641-a166-ccdf808a281e service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-9d6c13f7-b4d8-4958-8d29-6a024b02a206 req-edd62dec-3463-4641-a166-ccdf808a281e service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-unplugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Instance destroyed successfully.
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'resources' on Instance uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-152740879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-152740879',id=25,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:06:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-bxm0e8ww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:08:23Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=cee17c90-5f3f-4455-a696-4ba11cd02451,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "66f1f97a-8d33-486b-86ec-59754c68b651", "address": "fa:16:3e:30:46:d0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f1f97a-8d", "ovs_interfaceid": "66f1f97a-8d33-486b-86ec-59754c68b651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_vif [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66f1f97a-8d, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e50b1ad-9d89-4074-9684-922d5dd25b0c) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:09 user nova-compute[75734]: INFO os_vif [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:46:d0,bridge_name='br-int',has_traffic_filtering=True,id=66f1f97a-8d33-486b-86ec-59754c68b651,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f1f97a-8d')
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdbGXOfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:10:09 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce219606-70fe-4ecb-9ecc-7af4b0b30c97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:10:09 user nova-compute[75734]: No targets found.
Nov 22 16:10:09 user nova-compute[75734]: iSNS:
Nov 22 16:10:09 user nova-compute[75734]: No targets found.
Nov 22 16:10:09 user nova-compute[75734]: STATIC:
Nov 22 16:10:09 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe
Nov 22 16:10:09 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:09 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:09 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:10:09 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:09 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:09 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99
Nov 22 16:10:09 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:09 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:09 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:10:09 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:09 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:09 user nova-compute[75734]: FIRMWARE:
Nov 22 16:10:09 user nova-compute[75734]: No targets found.
Nov 22 16:10:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:10:09 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:10:09 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[16299f32-cc81-4b5b-98f1-5dd8ac84a842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac5677-c760-4c21-9e81-48e6999a983c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:10:09 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:10:09 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:10:09 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:10:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:10:09 user nova-compute[75734]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 (non-flash)
Nov 22 16:10:09 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:10:09 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:10:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac788280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99'): ({'sdh'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Removing single pathed devices sdh {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7634af38-ba2f-4411-bd08-f3ee3c3b3540]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc11aa3-2999-4edb-81c0-1505964050a1]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flushing IO for device /dev/sdh {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fe5419-d3cc-445f-80f9-5984d0e661ca]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5253da-4aa6-45ba-81e6-cbeb69621dbf]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] SCSI volumes sdh have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1579f06a-eb4930e296896494', '/dev/disk/by-id/scsi-26562343933306532', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1579f06a') {{(pid=86452) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 16:10:09 user nova-compute[75734]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1579f06a-eb4930e296896494
Nov 22 16:10:09 user nova-compute[75734]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26562343933306532
Nov 22 16:10:09 user nova-compute[75734]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1579f06a
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7270197d-c2f6-42b0-9033-e0cb7e383af1]: (4, None) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3897c669-31f8-4ce8-af43-a04c776e68ee]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'flavor' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-519f6151-c8cf-4a75-8b3b-d0b98571a59a tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.880s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[350322e0-d6f1-4f33-a92a-a496bfc9c7cf]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260]
Nov 22 16:10:09 user nova-compute[75734]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99, portal: 172.16.0.220,3260] successful.
Nov 22 16:10:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4a34a8-c78f-4372-9828-4f707d420f99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19c00b9-3396-4b7e-8f7c-7a7317ef4641]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== disconnect_volume: return (332ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:10:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Deleting instance files /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451_del
Nov 22 16:10:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Deletion of /opt/stack/data/nova/instances/cee17c90-5f3f-4455-a696-4ba11cd02451_del complete
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:10:09 user nova-compute[75734]: INFO nova.compute.manager [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:10:09 user nova-compute[75734]: WARNING nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid fc118db4-cb7d-4887-80c8-853f3f76a33a {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid b039f669-d399-49f3-baf5-4a21c8847ab0 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid c76e93b4-c666-4a61-a09f-8ec45fee55d4 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid cee17c90-5f3f-4455-a696-4ba11cd02451 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 4feab9cc-6678-49c0-912d-faa72e5e68ca {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 6252f7b5-0458-42d4-8747-dfe425918dec {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:10 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Took 0.53 seconds to deallocate network for instance.
Nov 22 16:10:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-efa3f51d-583e-4112-b3ea-f84ff5836fbb req-1bf8d6eb-9c38-4750-b1a0-c691343d0820 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-deleted-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:10 user nova-compute[75734]: INFO nova.compute.manager [req-efa3f51d-583e-4112-b3ea-f84ff5836fbb req-1bf8d6eb-9c38-4750-b1a0-c691343d0820 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Neutron deleted interface 66f1f97a-8d33-486b-86ec-59754c68b651; detaching it from the instance and deleting it from the info cache
Nov 22 16:10:10 user nova-compute[75734]: DEBUG nova.network.neutron [req-efa3f51d-583e-4112-b3ea-f84ff5836fbb req-1bf8d6eb-9c38-4750-b1a0-c691343d0820 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-efa3f51d-583e-4112-b3ea-f84ff5836fbb req-1bf8d6eb-9c38-4750-b1a0-c691343d0820 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Detach interface failed, port_id=66f1f97a-8d33-486b-86ec-59754c68b651, reason: Instance cee17c90-5f3f-4455-a696-4ba11cd02451 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:10:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-acbe2b3a-5bd0-4a7e-a0f2-d4786c4bc249 req-fbac67a8-713a-4d68-86c7-e53c374c2019 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-acbe2b3a-5bd0-4a7e-a0f2-d4786c4bc249 req-fbac67a8-713a-4d68-86c7-e53c374c2019 service nova] Acquiring lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-acbe2b3a-5bd0-4a7e-a0f2-d4786c4bc249 req-fbac67a8-713a-4d68-86c7-e53c374c2019 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-acbe2b3a-5bd0-4a7e-a0f2-d4786c4bc249 req-fbac67a8-713a-4d68-86c7-e53c374c2019 service nova] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-acbe2b3a-5bd0-4a7e-a0f2-d4786c4bc249 req-fbac67a8-713a-4d68-86c7-e53c374c2019 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] No waiting events found dispatching network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:11 user nova-compute[75734]: WARNING nova.compute.manager [req-acbe2b3a-5bd0-4a7e-a0f2-d4786c4bc249 req-fbac67a8-713a-4d68-86c7-e53c374c2019 service nova] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Received unexpected event network-vif-plugged-66f1f97a-8d33-486b-86ec-59754c68b651 for instance with vm_state active and task_state deleting.
Nov 22 16:10:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:13 user nova-compute[75734]: INFO nova.compute.manager [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] Took 2.87 seconds to detach 1 volumes for instance.
Nov 22 16:10:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:13 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:10:13 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:10:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:13 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Deleted allocations for instance cee17c90-5f3f-4455-a696-4ba11cd02451
Nov 22 16:10:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-316017e6-ba02-44d6-98dc-caf1cf98477b tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.141s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.891s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:13 user nova-compute[75734]: INFO nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: cee17c90-5f3f-4455-a696-4ba11cd02451] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 22 16:10:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "cee17c90-5f3f-4455-a696-4ba11cd02451" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:10:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:10:27 user nova-compute[75734]: INFO nova.compute.claims [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Claim successful on node user
Nov 22 16:10:27 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:10:27 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:10:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.policy [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb5b3c03bbb490f9ef6f3f9c70bf9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7d5b5135ca46c2a649df3c1ce2ac64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:10:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Creating image(s)
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "/opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "/opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk 1073741824" returned: 0 in 0.055s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Successfully created port: 76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Cannot resize image /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:10:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Ensure instance console log exists: /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Successfully updated port: 76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquired lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-changed-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Refreshing instance network info cache due to event network-changed-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] Acquiring lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updating instance_info_cache with network_info: [{"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Releasing lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Instance network_info: |[{"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] Acquired lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.neutron [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Refreshing network info cache for port 76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Start _get_guest_xml network_info=[{"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:10:29 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:10:29 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-111668328',display_name='tempest-AttachVolumeNegativeTest-server-111668328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-111668328',id=32,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkfwLgoOyf6LAiY0c46AVEim8ls+AeOLG/+Iz79hDsruzwsnX6QPjQAtGNY6e0UtbaGUQCZhZFVU2aPMrahZsNHf2blTBa8LYdwZUqasjMhbOnGOfMgmW30dJYssEVbhQ==',key_name='tempest-keypair-1497542988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-2vtmpu7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:10:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=522e8f05-a119-4f0b-8e02-eb90e9fce744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9e:34,bridge_name='br-int',has_traffic_filtering=True,id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76164a7b-ea') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'pci_devices' on Instance uuid 522e8f05-a119-4f0b-8e02-eb90e9fce744 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:10:29 user nova-compute[75734]:   <uuid>522e8f05-a119-4f0b-8e02-eb90e9fce744</uuid>
Nov 22 16:10:29 user nova-compute[75734]:   <name>instance-00000020</name>
Nov 22 16:10:29 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:10:29 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:10:29 user nova-compute[75734]:   <metadata>
Nov 22 16:10:29 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:10:29 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:10:29 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeNegativeTest-server-111668328</nova:name>
Nov 22 16:10:29 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:10:29</nova:creationTime>
Nov 22 16:10:29 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:10:29 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:10:29 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:10:29 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:10:29 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:10:29 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:10:29 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:10:29 user nova-compute[75734]:       <nova:owner>
Nov 22 16:10:29 user nova-compute[75734]:         <nova:user uuid="abb5b3c03bbb490f9ef6f3f9c70bf9d2">tempest-AttachVolumeNegativeTest-2104845353-project-member</nova:user>
Nov 22 16:10:29 user nova-compute[75734]:         <nova:project uuid="cb7d5b5135ca46c2a649df3c1ce2ac64">tempest-AttachVolumeNegativeTest-2104845353</nova:project>
Nov 22 16:10:29 user nova-compute[75734]:       </nova:owner>
Nov 22 16:10:29 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:10:29 user nova-compute[75734]:       <nova:ports>
Nov 22 16:10:29 user nova-compute[75734]:         <nova:port uuid="76164a7b-eac4-4f33-8fd3-b2cb72d68bcc">
Nov 22 16:10:29 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 16:10:29 user nova-compute[75734]:         </nova:port>
Nov 22 16:10:29 user nova-compute[75734]:       </nova:ports>
Nov 22 16:10:29 user nova-compute[75734]:     </nova:instance>
Nov 22 16:10:29 user nova-compute[75734]:   </metadata>
Nov 22 16:10:29 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:10:29 user nova-compute[75734]:     <system>
Nov 22 16:10:29 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:10:29 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:10:29 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:10:29 user nova-compute[75734]:       <entry name="serial">522e8f05-a119-4f0b-8e02-eb90e9fce744</entry>
Nov 22 16:10:29 user nova-compute[75734]:       <entry name="uuid">522e8f05-a119-4f0b-8e02-eb90e9fce744</entry>
Nov 22 16:10:29 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:10:29 user nova-compute[75734]:     </system>
Nov 22 16:10:29 user nova-compute[75734]:   </sysinfo>
Nov 22 16:10:29 user nova-compute[75734]:   <os>
Nov 22 16:10:29 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:10:29 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:10:29 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:10:29 user nova-compute[75734]:   </os>
Nov 22 16:10:29 user nova-compute[75734]:   <features>
Nov 22 16:10:29 user nova-compute[75734]:     <acpi/>
Nov 22 16:10:29 user nova-compute[75734]:     <apic/>
Nov 22 16:10:29 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:10:29 user nova-compute[75734]:   </features>
Nov 22 16:10:29 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:10:29 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:10:29 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:10:29 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:10:29 user nova-compute[75734]:   </clock>
Nov 22 16:10:29 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:10:29 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:10:29 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:10:29 user nova-compute[75734]:   </cpu>
Nov 22 16:10:29 user nova-compute[75734]:   <devices>
Nov 22 16:10:29 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:10:29 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:10:29 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk"/>
Nov 22 16:10:29 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:10:29 user nova-compute[75734]:     </disk>
Nov 22 16:10:29 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:10:29 user nova-compute[75734]:       <mac address="fa:16:3e:4a:9e:34"/>
Nov 22 16:10:29 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:10:29 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:10:29 user nova-compute[75734]:       <target dev="tap76164a7b-ea"/>
Nov 22 16:10:29 user nova-compute[75734]:     </interface>
Nov 22 16:10:29 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:10:29 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/console.log" append="off"/>
Nov 22 16:10:29 user nova-compute[75734]:     </serial>
Nov 22 16:10:29 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:10:29 user nova-compute[75734]:     <video>
Nov 22 16:10:29 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:10:29 user nova-compute[75734]:     </video>
Nov 22 16:10:29 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:10:29 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:10:29 user nova-compute[75734]:     </rng>
Nov 22 16:10:29 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:10:29 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:10:29 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:10:29 user nova-compute[75734]:     </memballoon>
Nov 22 16:10:29 user nova-compute[75734]:   </devices>
Nov 22 16:10:29 user nova-compute[75734]: </domain>
Nov 22 16:10:29 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-111668328',display_name='tempest-AttachVolumeNegativeTest-server-111668328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-111668328',id=32,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkfwLgoOyf6LAiY0c46AVEim8ls+AeOLG/+Iz79hDsruzwsnX6QPjQAtGNY6e0UtbaGUQCZhZFVU2aPMrahZsNHf2blTBa8LYdwZUqasjMhbOnGOfMgmW30dJYssEVbhQ==',key_name='tempest-keypair-1497542988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-2vtmpu7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:10:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=522e8f05-a119-4f0b-8e02-eb90e9fce744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9e:34,bridge_name='br-int',has_traffic_filtering=True,id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76164a7b-ea') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG os_vif [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9e:34,bridge_name='br-int',has_traffic_filtering=True,id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76164a7b-ea') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c937117c-678c-5736-a4a7-5081d3760706', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76164a7b-ea, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76164a7b-ea, col_values=(('qos', UUID('1554200d-2575-4435-805d-032c9daf2c3b')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76164a7b-ea, col_values=(('external_ids', {'iface-id': '76164a7b-eac4-4f33-8fd3-b2cb72d68bcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:9e:34', 'vm-uuid': '522e8f05-a119-4f0b-8e02-eb90e9fce744'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:29 user nova-compute[75734]: INFO os_vif [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9e:34,bridge_name='br-int',has_traffic_filtering=True,id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76164a7b-ea')
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:10:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No VIF found with MAC fa:16:3e:4a:9e:34, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:10:30 user nova-compute[75734]: DEBUG nova.network.neutron [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updated VIF entry in instance network info cache for port 76164a7b-eac4-4f33-8fd3-b2cb72d68bcc. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:10:30 user nova-compute[75734]: DEBUG nova.network.neutron [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updating instance_info_cache with network_info: [{"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cb290db7-46cd-4ce4-8ab4-815f1cc91096 req-52376e8f-7885-4cca-808f-083d20c41560 service nova] Releasing lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-4e03b0dd-c2ba-4a9f-8d22-56f05ddc821f req-715263a7-9581-40bb-ae31-90ed6b4d89ef service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4e03b0dd-c2ba-4a9f-8d22-56f05ddc821f req-715263a7-9581-40bb-ae31-90ed6b4d89ef service nova] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4e03b0dd-c2ba-4a9f-8d22-56f05ddc821f req-715263a7-9581-40bb-ae31-90ed6b4d89ef service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4e03b0dd-c2ba-4a9f-8d22-56f05ddc821f req-715263a7-9581-40bb-ae31-90ed6b4d89ef service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-4e03b0dd-c2ba-4a9f-8d22-56f05ddc821f req-715263a7-9581-40bb-ae31-90ed6b4d89ef service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] No waiting events found dispatching network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:31 user nova-compute[75734]: WARNING nova.compute.manager [req-4e03b0dd-c2ba-4a9f-8d22-56f05ddc821f req-715263a7-9581-40bb-ae31-90ed6b4d89ef service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received unexpected event network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc for instance with vm_state building and task_state spawning.
Nov 22 16:10:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:32 user nova-compute[75734]: INFO nova.compute.manager [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Terminating instance
Nov 22 16:10:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-bf430a65-9f59-41f8-a5d7-68277448e07a req-8c438489-1966-44cf-bf9f-bbfdea9b694f service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received event network-vif-unplugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bf430a65-9f59-41f8-a5d7-68277448e07a req-8c438489-1966-44cf-bf9f-bbfdea9b694f service nova] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bf430a65-9f59-41f8-a5d7-68277448e07a req-8c438489-1966-44cf-bf9f-bbfdea9b694f service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bf430a65-9f59-41f8-a5d7-68277448e07a req-8c438489-1966-44cf-bf9f-bbfdea9b694f service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-bf430a65-9f59-41f8-a5d7-68277448e07a req-8c438489-1966-44cf-bf9f-bbfdea9b694f service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] No waiting events found dispatching network-vif-unplugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-bf430a65-9f59-41f8-a5d7-68277448e07a req-8c438489-1966-44cf-bf9f-bbfdea9b694f service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received event network-vif-unplugged-31eaece0-6f7f-41a3-8b12-70df22408d94 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.compute.manager [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Terminating instance
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Instance destroyed successfully.
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lazy-loading 'resources' on Instance uuid 4feab9cc-6678-49c0-912d-faa72e5e68ca {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-879259954',display_name='tempest-VolumesActionsTest-instance-879259954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-879259954',id=30,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:08:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f32f21ea574502bb22f0c65e02307c',ramdisk_id='',reservation_id='r-60ocnofg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-233001274',owner_user_name='tempest-VolumesActionsTest-233001274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:08:48Z,user_data=None,user_id='9e4416aa9b484a609622819875bbd32b',uuid=4feab9cc-6678-49c0-912d-faa72e5e68ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converting VIF {"id": "31eaece0-6f7f-41a3-8b12-70df22408d94", "address": "fa:16:3e:14:99:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31eaece0-6f", "ovs_interfaceid": "31eaece0-6f7f-41a3-8b12-70df22408d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:99:11,bridge_name='br-int',has_traffic_filtering=True,id=31eaece0-6f7f-41a3-8b12-70df22408d94,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31eaece0-6f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG os_vif [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:99:11,bridge_name='br-int',has_traffic_filtering=True,id=31eaece0-6f7f-41a3-8b12-70df22408d94,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31eaece0-6f') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31eaece0-6f, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=076c7431-6299-462e-9f70-9ccc0d646d8e) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-c718fe1b-160d-4d9d-954a-d59521be9cc2 req-fc72ef27-bed1-432f-bf50-691af131a54b service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c718fe1b-160d-4d9d-954a-d59521be9cc2 req-fc72ef27-bed1-432f-bf50-691af131a54b service nova] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c718fe1b-160d-4d9d-954a-d59521be9cc2 req-fc72ef27-bed1-432f-bf50-691af131a54b service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c718fe1b-160d-4d9d-954a-d59521be9cc2 req-fc72ef27-bed1-432f-bf50-691af131a54b service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-c718fe1b-160d-4d9d-954a-d59521be9cc2 req-fc72ef27-bed1-432f-bf50-691af131a54b service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] No waiting events found dispatching network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:33 user nova-compute[75734]: WARNING nova.compute.manager [req-c718fe1b-160d-4d9d-954a-d59521be9cc2 req-fc72ef27-bed1-432f-bf50-691af131a54b service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received unexpected event network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc for instance with vm_state building and task_state spawning.
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: INFO os_vif [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:99:11,bridge_name='br-int',has_traffic_filtering=True,id=31eaece0-6f7f-41a3-8b12-70df22408d94,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31eaece0-6f')
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Deleting instance files /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca_del
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Deletion of /opt/stack/data/nova/instances/4feab9cc-6678-49c0-912d-faa72e5e68ca_del complete
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Instance spawned successfully.
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.compute.manager [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.compute.manager [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Took 6.13 seconds to build instance.
Nov 22 16:10:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0ce82c01-0d72-4cc3-af49-6c2fb56172eb tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.222s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Instance destroyed successfully.
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lazy-loading 'resources' on Instance uuid 90daf829-e4b2-4f46-a915-d2374bb0896c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1762983324',display_name='tempest-SnapshotDataIntegrityTests-server-1762983324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1762983324',id=24,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZGmfwPjB/VXRFm34XgEFEsw/gBJONz9y0lFKVZk2c2/Ypgnl3L3zYeGyzBR6+AglzW+4MDtpO/FVYhGEVLiZwWgQtZTam6919CLnxFwv+fwPBxQn4MuGWCNJMdOcPMjg==',key_name='tempest-keypair-874668113',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:03:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa94e0f8306e45668c29e5a296222069',ramdisk_id='',reservation_id='r-988tmhyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-388543575',owner_user_name='tempest-SnapshotDataIntegrityTests-388543575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:03:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50ff8d823484b29a664d2a0d19f6fc0',uuid=90daf829-e4b2-4f46-a915-d2374bb0896c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Converting VIF {"id": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "address": "fa:16:3e:de:13:28", "network": {"id": "bd40a1f6-a581-41b1-9db5-234894296ea8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235365924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa94e0f8306e45668c29e5a296222069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1268d1-c6", "ovs_interfaceid": "4d1268d1-c615-41a0-9db7-7eec1b68a27d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:13:28,bridge_name='br-int',has_traffic_filtering=True,id=4d1268d1-c615-41a0-9db7-7eec1b68a27d,network=Network(bd40a1f6-a581-41b1-9db5-234894296ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1268d1-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG os_vif [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:13:28,bridge_name='br-int',has_traffic_filtering=True,id=4d1268d1-c615-41a0-9db7-7eec1b68a27d,network=Network(bd40a1f6-a581-41b1-9db5-234894296ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1268d1-c6') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d1268d1-c6, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4b63868-9f17-4d61-8081-52f592c1bf27) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:33 user nova-compute[75734]: INFO os_vif [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:13:28,bridge_name='br-int',has_traffic_filtering=True,id=4d1268d1-c615-41a0-9db7-7eec1b68a27d,network=Network(bd40a1f6-a581-41b1-9db5-234894296ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1268d1-c6')
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Deleting instance files /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c_del
Nov 22 16:10:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Deletion of /opt/stack/data/nova/instances/90daf829-e4b2-4f46-a915-d2374bb0896c_del complete
Nov 22 16:10:34 user nova-compute[75734]: INFO nova.compute.manager [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 22 16:10:34 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:34 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Took 0.68 seconds to deallocate network for instance.
Nov 22 16:10:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:34 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Deleted allocations for instance 4feab9cc-6678-49c0-912d-faa72e5e68ca
Nov 22 16:10:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7aa5e7bc-bcb9-47d2-bac1-632af0d5ea11 tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received event network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Acquiring lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Lock "4feab9cc-6678-49c0-912d-faa72e5e68ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] No waiting events found dispatching network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:35 user nova-compute[75734]: WARNING nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received unexpected event network-vif-plugged-31eaece0-6f7f-41a3-8b12-70df22408d94 for instance with vm_state deleted and task_state None.
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-vif-unplugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] No waiting events found dispatching network-vif-unplugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-vif-unplugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Acquiring lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] No waiting events found dispatching network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:10:35 user nova-compute[75734]: WARNING nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received unexpected event network-vif-plugged-4d1268d1-c615-41a0-9db7-7eec1b68a27d for instance with vm_state active and task_state deleting.
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-d30a33bf-027d-44e0-9d05-1303f3a76668 req-58a30ce1-66fe-42ea-871d-46a8a8223a08 service nova] [instance: 4feab9cc-6678-49c0-912d-faa72e5e68ca] Received event network-vif-deleted-31eaece0-6f7f-41a3-8b12-70df22408d94 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:35 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Took 0.88 seconds to deallocate network for instance.
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:35 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Deleted allocations for instance 90daf829-e4b2-4f46-a915-d2374bb0896c
Nov 22 16:10:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b705f015-28f0-48f7-9ff9-f811b273df7a tempest-SnapshotDataIntegrityTests-388543575 tempest-SnapshotDataIntegrityTests-388543575-project-member] Lock "90daf829-e4b2-4f46-a915-d2374bb0896c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.524s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-93a096e0-1060-4448-8027-a38389e7c48c req-90308210-093f-44c9-b600-0ae985fae29c service nova] [instance: 90daf829-e4b2-4f46-a915-d2374bb0896c] Received event network-vif-deleted-4d1268d1-c615-41a0-9db7-7eec1b68a27d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:38 user nova-compute[75734]: INFO nova.compute.manager [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Detaching volume e7e83999-fe9e-449b-a62a-01a353377bfe
Nov 22 16:10:38 user nova-compute[75734]: INFO nova.virt.block_device [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Attempting to driver detach volume e7e83999-fe9e-449b-a62a-01a353377bfe from mountpoint /dev/vdb
Nov 22 16:10:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Attempting to detach device vdb from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:10:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:10:38 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:10:38 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:10:38 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:10:38 user nova-compute[75734]:   <serial>e7e83999-fe9e-449b-a62a-01a353377bfe</serial>
Nov 22 16:10:38 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:10:38 user nova-compute[75734]: </disk>
Nov 22 16:10:38 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:10:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Successfully detached device vdb from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the persistent domain config.
Nov 22 16:10:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:10:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:10:38 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:10:38 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:10:38 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:10:38 user nova-compute[75734]:   <serial>e7e83999-fe9e-449b-a62a-01a353377bfe</serial>
Nov 22 16:10:38 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:10:38 user nova-compute[75734]: </disk>
Nov 22 16:10:38 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:10:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:10:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:10:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:10:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:10:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:10:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:48 user nova-compute[75734]: INFO nova.compute.manager [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Unshelving
Nov 22 16:10:48 user nova-compute[75734]: INFO nova.virt.block_device [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Booting with volume 8505e510-b813-4d8b-973e-c886ceb416f0 at /dev/vdc
Nov 22 16:10:48 user nova-compute[75734]: DEBUG os_brick.utils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e261969-87ec-447a-83b5-b135a0187035]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d827c029-6b1c-467b-a72c-f79d6d19c5b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a8c518-58e5-4f50-b295-f7167d457343]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb12be74-311b-4705-bdcd-c904b31b7ad9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:10:48 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:10:48 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c516a-f3af-402b-bc5d-0dcfd7a0d253]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG os_brick.utils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating existing volume attachment record: 1867f2d9-ceff-48f6-9446-8d5cacfdb95e {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:10:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:54 user nova-compute[75734]: DEBUG nova.objects.instance [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'pci_requests' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:54 user nova-compute[75734]: DEBUG nova.objects.instance [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:54 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:10:54 user nova-compute[75734]: INFO nova.compute.claims [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Claim successful on node user
Nov 22 16:10:55 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:10:55 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:10:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:55 user nova-compute[75734]: INFO nova.network.neutron [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating port c5d05c23-c676-43f3-845f-bf210be313b2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 16:10:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:10:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquired lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.network.neutron [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.compute.manager [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing instance network info cache due to event network-changed-c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] Acquiring lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.network.neutron [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Releasing lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:10:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Creating image(s)
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.objects.instance [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] Acquired lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.network.neutron [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Refreshing network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.objects.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<0bb36614-4020-4eb5-81b3-f8e9a5f43541> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "2f75cce48d63c62a4280a5e5d921fd477b13b4a1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "2f75cce48d63c62a4280a5e5d921fd477b13b4a1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:56 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.part --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG nova.virt.images [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] 53bedd26-899e-427b-a075-d834457c04c1 was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.part /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG nova.network.neutron [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updated VIF entry in instance network info cache for port c5d05c23-c676-43f3-845f-bf210be313b2. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG nova.network.neutron [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f6512803-bffc-4d5e-a3d8-ff350732ecc3 req-99b5ecf1-0d9c-44f8-8a82-2ae43db5b7f4 service nova] Releasing lock "refresh_cache-0bb36614-4020-4eb5-81b3-f8e9a5f43541" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.part /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.converted" returned: 0 in 0.928s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "2f75cce48d63c62a4280a5e5d921fd477b13b4a1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.337s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 is timed out.
Nov 22 16:10:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Successfully detached device vdb from instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 from the live domain config.
Nov 22 16:10:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viKZBzYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:10:59 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "2f75cce48d63c62a4280a5e5d921fd477b13b4a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "2f75cce48d63c62a4280a5e5d921fd477b13b4a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5da072-7302-4462-919e-bee22da30c00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:10:59 user nova-compute[75734]: No targets found.
Nov 22 16:10:59 user nova-compute[75734]: iSNS:
Nov 22 16:10:59 user nova-compute[75734]: No targets found.
Nov 22 16:10:59 user nova-compute[75734]: STATIC:
Nov 22 16:10:59 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe
Nov 22 16:10:59 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:59 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:59 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:10:59 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:59 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:59 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:10:59 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:10:59 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:10:59 user nova-compute[75734]: FIRMWARE:
Nov 22 16:10:59 user nova-compute[75734]: No targets found.
Nov 22 16:10:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:10:59 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:10:59 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[867733cc-5532-4c62-beb6-f32a17ba8226]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b013c0-fc92-4c39-9ca4-44d24c013570]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:10:59 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:10:59 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:10:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:10:59 user nova-compute[75734]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe (non-flash)
Nov 22 16:10:59 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:10:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7bff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[230291ee-c0a1-4395-aa47-1ac080d02424]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3a6d3d-6ee3-45d7-9a70-193ae87dd372]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1,backing_fmt=raw /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6db1613-a468-4384-b693-59b66d30c059]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1,backing_fmt=raw /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk 1073741824" returned: 0 in 0.053s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "2f75cce48d63c62a4280a5e5d921fd477b13b4a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[027268b0-c1f8-4764-9fda-3656846351b2]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1db2f1-39a8-40c3-801c-65ed2fe82894]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc44fe-28ec-407c-a287-28a87b2e815b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260]
Nov 22 16:10:59 user nova-compute[75734]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe, portal: 172.16.0.220,3260] successful.
Nov 22 16:10:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e83999-fe9e-449b-a62a-01a353377bfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566ab7b-088a-4127-ad21-1e14223bbe15]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] <== disconnect_volume: return (436ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1 --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG nova.objects.instance [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'migration_context' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG nova.objects.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<0bb36614-4020-4eb5-81b3-f8e9a5f43541> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:10:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Rebasing disk image.
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:10:59 user nova-compute[75734]: INFO nova.compute.manager [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Terminating instance
Nov 22 16:10:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 -F raw /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:10:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'flavor' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-339f26ef-23d6-4023-be78-8c05ff4e392a req-2abf28c6-fe5a-43eb-9413-d7f5662c626e service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received event network-vif-unplugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-339f26ef-23d6-4023-be78-8c05ff4e392a req-2abf28c6-fe5a-43eb-9413-d7f5662c626e service nova] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-339f26ef-23d6-4023-be78-8c05ff4e392a req-2abf28c6-fe5a-43eb-9413-d7f5662c626e service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-339f26ef-23d6-4023-be78-8c05ff4e392a req-2abf28c6-fe5a-43eb-9413-d7f5662c626e service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-339f26ef-23d6-4023-be78-8c05ff4e392a req-2abf28c6-fe5a-43eb-9413-d7f5662c626e service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] No waiting events found dispatching network-vif-unplugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-339f26ef-23d6-4023-be78-8c05ff4e392a req-2abf28c6-fe5a-43eb-9413-d7f5662c626e service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received event network-vif-unplugged-aade74b3-cd01-47c0-8443-2a1ae23343af for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:11:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Instance destroyed successfully.
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'resources' on Instance uuid c76e93b4-c666-4a61-a09f-8ec45fee55d4 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:11:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=24.874351501464844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d794f990-922e-40fb-88b7-46eaea3160c5 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.039s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1861221698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1861221698',id=21,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:01:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-q441otei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:03:34Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=c76e93b4-c666-4a61-a09f-8ec45fee55d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "aade74b3-cd01-47c0-8443-2a1ae23343af", "address": "fa:16:3e:99:b1:44", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaade74b3-cd", "ovs_interfaceid": "aade74b3-cd01-47c0-8443-2a1ae23343af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b1:44,bridge_name='br-int',has_traffic_filtering=True,id=aade74b3-cd01-47c0-8443-2a1ae23343af,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaade74b3-cd') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG os_vif [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b1:44,bridge_name='br-int',has_traffic_filtering=True,id=aade74b3-cd01-47c0-8443-2a1ae23343af,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaade74b3-cd') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaade74b3-cd, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=feb5515c-2e5f-4934-9263-1b6ffe67214f) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:00 user nova-compute[75734]: INFO os_vif [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b1:44,bridge_name='br-int',has_traffic_filtering=True,id=aade74b3-cd01-47c0-8443-2a1ae23343af,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaade74b3-cd')
Nov 22 16:11:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Deleting instance files /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4_del
Nov 22 16:11:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Deletion of /opt/stack/data/nova/instances/c76e93b4-c666-4a61-a09f-8ec45fee55d4_del complete
Nov 22 16:11:00 user nova-compute[75734]: INFO nova.compute.manager [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c76e93b4-c666-4a61-a09f-8ec45fee55d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 6252f7b5-0458-42d4-8747-dfe425918dec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (37d0620c-15f4-4d5b-869d-cafca8d2e0e2): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:11:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:01 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:01 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Took 0.72 seconds to deallocate network for instance.
Nov 22 16:11:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:01 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:11:01 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:11:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:01 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Deleted allocations for instance c76e93b4-c666-4a61-a09f-8ec45fee55d4
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-582a43a4-15ad-47e6-8aab-6cc89e232728 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-15940fa2-664f-495d-91d3-4ac8042052da req-b763a961-e57d-41e6-b5ed-79436a747e56 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received event network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-15940fa2-664f-495d-91d3-4ac8042052da req-b763a961-e57d-41e6-b5ed-79436a747e56 service nova] Acquiring lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-15940fa2-664f-495d-91d3-4ac8042052da req-b763a961-e57d-41e6-b5ed-79436a747e56 service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-15940fa2-664f-495d-91d3-4ac8042052da req-b763a961-e57d-41e6-b5ed-79436a747e56 service nova] Lock "c76e93b4-c666-4a61-a09f-8ec45fee55d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-15940fa2-664f-495d-91d3-4ac8042052da req-b763a961-e57d-41e6-b5ed-79436a747e56 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] No waiting events found dispatching network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:02 user nova-compute[75734]: WARNING nova.compute.manager [req-15940fa2-664f-495d-91d3-4ac8042052da req-b763a961-e57d-41e6-b5ed-79436a747e56 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received unexpected event network-vif-plugged-aade74b3-cd01-47c0-8443-2a1ae23343af for instance with vm_state deleted and task_state None.
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-15940fa2-664f-495d-91d3-4ac8042052da req-b763a961-e57d-41e6-b5ed-79436a747e56 service nova] [instance: c76e93b4-c666-4a61-a09f-8ec45fee55d4] Received event network-vif-deleted-aade74b3-cd01-47c0-8443-2a1ae23343af {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 -F raw /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk" returned: 0 in 2.571s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Ensure instance console log exists: /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Start _get_guest_xml network_info=[{"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='74eca86c85f16a99dbf0d4f17c45e21d',container_format='bare',created_at=2023-11-22T16:08:56Z,direct_url=<?>,disk_format='qcow2',id=53bedd26-899e-427b-a075-d834457c04c1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-620964655-shelved',owner='c0470a32bf194b2ca5de3bd71af4409d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-22T16:09:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1867f2d9-ceff-48f6-9446-8d5cacfdb95e', 'boot_index': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTdfPMHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0bb36614-4020-4eb5-81b3-f8e9a5f43541', 'attached_at': '', 'detached_at': '', 'volume_id': '8505e510-b813-4d8b-973e-c886ceb416f0', 'serial': '8505e510-b813-4d8b-973e-c886ceb416f0'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:11:02 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:02 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='74eca86c85f16a99dbf0d4f17c45e21d',container_format='bare',created_at=2023-11-22T16:08:56Z,direct_url=<?>,disk_format='qcow2',id=53bedd26-899e-427b-a075-d834457c04c1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-620964655-shelved',owner='c0470a32bf194b2ca5de3bd71af4409d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-22T16:09:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.objects.instance [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.objects.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<0bb36614-4020-4eb5-81b3-f8e9a5f43541> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTdfPMHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:11:02 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:11:02 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:11:02 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31684567-f707-4f2b-90cf-f67cb3c186ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:11:02 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bffe41-d902-4e9d-a514-ef5dd4945713]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0] added
Nov 22 16:11:02 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8dd0c2-db76-4cb4-9f42-cd78fa9ab39d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3787fe-a166-497e-9712-1dc620c21857]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTdfPMHA {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTdfPMHA" returned: 0 in 0.062s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea0dfba-4ab4-45d6-bc1c-8be77478d3d8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTdfPMHA'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2441cc-f305-42c0-96b8-bbe50cbf798b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c866421-6472-4198-ba78-35ba4595f457]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:02 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:02 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:02 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:02 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44bc4ac-2cff-4236-b1a7-935c3d386548]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260]
Nov 22 16:11:02 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260] successful.
Nov 22 16:11:02 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8654fba8-d590-47fa-bffe-6fd6377c8b64]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dd353e-0351-43ab-aee0-a0d44bf6b8f5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:02 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:02 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:02 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:02 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:02 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:02 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1993c2a6-8de2-43cb-90cb-9dde5dcd17ee]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:11:02 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTdfPMHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23335613666353831', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335613666353831', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620964655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620964655',id=28,image_ref='53bedd26-899e-427b-a075-d834457c04c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1677415622',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-dgsvht2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member',shelved_at='2023-11-22T16:09:00.411857',shelved_host='user',shelved_image_id='53bedd26-899e-427b-a075-d834457c04c1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=0bb36614-4020-4eb5-81b3-f8e9a5f43541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.objects.instance [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.objects.base [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<0bb36614-4020-4eb5-81b3-f8e9a5f43541> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:11:03 user nova-compute[75734]:   <uuid>0bb36614-4020-4eb5-81b3-f8e9a5f43541</uuid>
Nov 22 16:11:03 user nova-compute[75734]:   <name>instance-0000001c</name>
Nov 22 16:11:03 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:11:03 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:11:03 user nova-compute[75734]:   <metadata>
Nov 22 16:11:03 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:11:03 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:11:03 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-620964655</nova:name>
Nov 22 16:11:03 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:11:02</nova:creationTime>
Nov 22 16:11:03 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:11:03 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:11:03 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:11:03 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:11:03 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:11:03 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:11:03 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:11:03 user nova-compute[75734]:       <nova:owner>
Nov 22 16:11:03 user nova-compute[75734]:         <nova:user uuid="4c444f0bec7641458313d99ebcac79e1">tempest-AttachVolumeShelveTestJSON-1751141796-project-member</nova:user>
Nov 22 16:11:03 user nova-compute[75734]:         <nova:project uuid="c0470a32bf194b2ca5de3bd71af4409d">tempest-AttachVolumeShelveTestJSON-1751141796</nova:project>
Nov 22 16:11:03 user nova-compute[75734]:       </nova:owner>
Nov 22 16:11:03 user nova-compute[75734]:       <nova:root type="image" uuid="53bedd26-899e-427b-a075-d834457c04c1"/>
Nov 22 16:11:03 user nova-compute[75734]:       <nova:ports>
Nov 22 16:11:03 user nova-compute[75734]:         <nova:port uuid="c5d05c23-c676-43f3-845f-bf210be313b2">
Nov 22 16:11:03 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 16:11:03 user nova-compute[75734]:         </nova:port>
Nov 22 16:11:03 user nova-compute[75734]:       </nova:ports>
Nov 22 16:11:03 user nova-compute[75734]:     </nova:instance>
Nov 22 16:11:03 user nova-compute[75734]:   </metadata>
Nov 22 16:11:03 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:11:03 user nova-compute[75734]:     <system>
Nov 22 16:11:03 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:11:03 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:11:03 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:11:03 user nova-compute[75734]:       <entry name="serial">0bb36614-4020-4eb5-81b3-f8e9a5f43541</entry>
Nov 22 16:11:03 user nova-compute[75734]:       <entry name="uuid">0bb36614-4020-4eb5-81b3-f8e9a5f43541</entry>
Nov 22 16:11:03 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:11:03 user nova-compute[75734]:     </system>
Nov 22 16:11:03 user nova-compute[75734]:   </sysinfo>
Nov 22 16:11:03 user nova-compute[75734]:   <os>
Nov 22 16:11:03 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:11:03 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:11:03 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:11:03 user nova-compute[75734]:   </os>
Nov 22 16:11:03 user nova-compute[75734]:   <features>
Nov 22 16:11:03 user nova-compute[75734]:     <acpi/>
Nov 22 16:11:03 user nova-compute[75734]:     <apic/>
Nov 22 16:11:03 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:11:03 user nova-compute[75734]:   </features>
Nov 22 16:11:03 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:11:03 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:11:03 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:11:03 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:11:03 user nova-compute[75734]:   </clock>
Nov 22 16:11:03 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:11:03 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:11:03 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:11:03 user nova-compute[75734]:   </cpu>
Nov 22 16:11:03 user nova-compute[75734]:   <devices>
Nov 22 16:11:03 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:11:03 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:11:03 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk"/>
Nov 22 16:11:03 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:11:03 user nova-compute[75734]:     </disk>
Nov 22 16:11:03 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:11:03 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:11:03 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:11:03 user nova-compute[75734]:       <target dev="vdc" bus="virtio"/>
Nov 22 16:11:03 user nova-compute[75734]:       <serial>8505e510-b813-4d8b-973e-c886ceb416f0</serial>
Nov 22 16:11:03 user nova-compute[75734]:     </disk>
Nov 22 16:11:03 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:11:03 user nova-compute[75734]:       <mac address="fa:16:3e:1f:99:4f"/>
Nov 22 16:11:03 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:11:03 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:11:03 user nova-compute[75734]:       <target dev="tapc5d05c23-c6"/>
Nov 22 16:11:03 user nova-compute[75734]:     </interface>
Nov 22 16:11:03 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:11:03 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/console.log" append="off"/>
Nov 22 16:11:03 user nova-compute[75734]:     </serial>
Nov 22 16:11:03 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:11:03 user nova-compute[75734]:     <video>
Nov 22 16:11:03 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:11:03 user nova-compute[75734]:     </video>
Nov 22 16:11:03 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:11:03 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:11:03 user nova-compute[75734]:     </rng>
Nov 22 16:11:03 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:11:03 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:11:03 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:11:03 user nova-compute[75734]:     </memballoon>
Nov 22 16:11:03 user nova-compute[75734]:   </devices>
Nov 22 16:11:03 user nova-compute[75734]: </domain>
Nov 22 16:11:03 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620964655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620964655',id=28,image_ref='53bedd26-899e-427b-a075-d834457c04c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1677415622',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-dgsvht2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member',shelved_at='2023-11-22T16:09:00.411857',shelved_host='user',shelved_image_id='53bedd26-899e-427b-a075-d834457c04c1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=0bb36614-4020-4eb5-81b3-f8e9a5f43541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG os_vif [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c8ff4b1-9509-54b3-99a8-25bdab347c76', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5d05c23-c6, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5d05c23-c6, col_values=(('qos', UUID('08c7b1cd-26d4-4c8f-88d0-6324495de5d8')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5d05c23-c6, col_values=(('external_ids', {'iface-id': 'c5d05c23-c676-43f3-845f-bf210be313b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:99:4f', 'vm-uuid': '0bb36614-4020-4eb5-81b3-f8e9a5f43541'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:03 user nova-compute[75734]: INFO os_vif [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6')
Nov 22 16:11:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:11:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:11:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No VIF found with MAC fa:16:3e:1f:99:4f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-706d0a05-722d-468f-b4aa-3452e1fbf326 req-1c89010d-edfc-4c0e-a3b2-b53f25298928 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706d0a05-722d-468f-b4aa-3452e1fbf326 req-1c89010d-edfc-4c0e-a3b2-b53f25298928 service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706d0a05-722d-468f-b4aa-3452e1fbf326 req-1c89010d-edfc-4c0e-a3b2-b53f25298928 service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-706d0a05-722d-468f-b4aa-3452e1fbf326 req-1c89010d-edfc-4c0e-a3b2-b53f25298928 service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-706d0a05-722d-468f-b4aa-3452e1fbf326 req-1c89010d-edfc-4c0e-a3b2-b53f25298928 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:05 user nova-compute[75734]: WARNING nova.compute.manager [req-706d0a05-722d-468f-b4aa-3452e1fbf326 req-1c89010d-edfc-4c0e-a3b2-b53f25298928 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received unexpected event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 16:11:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:11:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:11:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-0e8659d4-617a-436d-b469-02783bfa7b8e req-ab2b39cf-9717-4e3e-a3f7-31f1a575bcdd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e8659d4-617a-436d-b469-02783bfa7b8e req-ab2b39cf-9717-4e3e-a3f7-31f1a575bcdd service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e8659d4-617a-436d-b469-02783bfa7b8e req-ab2b39cf-9717-4e3e-a3f7-31f1a575bcdd service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e8659d4-617a-436d-b469-02783bfa7b8e req-ab2b39cf-9717-4e3e-a3f7-31f1a575bcdd service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-0e8659d4-617a-436d-b469-02783bfa7b8e req-ab2b39cf-9717-4e3e-a3f7-31f1a575bcdd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:07 user nova-compute[75734]: WARNING nova.compute.manager [req-0e8659d4-617a-436d-b469-02783bfa7b8e req-ab2b39cf-9717-4e3e-a3f7-31f1a575bcdd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received unexpected event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 16:11:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance spawned successfully.
Nov 22 16:11:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:11:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-07babd18-38e5-43f8-b4aa-a8909fd84d6a tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.850s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-changed-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Refreshing instance network info cache due to event network-changed-9ae1c222-8eca-4705-88d5-e43f1819c1ff. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:11:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:11:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:11:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Refreshing network info cache for port 9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:11:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updated VIF entry in instance network info cache for port 9ae1c222-8eca-4705-88d5-e43f1819c1ff. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ac34937b-66c2-42b4-bc49-be5e90f8b102 req-3128227d-0bbd-4c87-8563-ff1ac5efe4b0 service nova] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "d886f816-fd98-41ad-8bdc-efb5b0baa131" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:11:24 user nova-compute[75734]: INFO nova.compute.claims [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Claim successful on node user
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:11:24 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:11:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.policy [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4416aa9b484a609622819875bbd32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f32f21ea574502bb22f0c65e02307c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:11:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Creating image(s)
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "/opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "/opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "/opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk 1073741824" returned: 0 in 0.065s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-changed-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Refreshing instance network info cache due to event network-changed-c2ad5c36-9639-489d-8106-02c283822b7a. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] Acquiring lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] Acquired lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Refreshing network info cache for port c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Successfully created port: 6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.244s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:11:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Cannot resize image /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Ensure instance console log exists: /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Stashing vm_state: active {{(pid=75734) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:11:26 user nova-compute[75734]: INFO nova.compute.claims [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Claim successful on node user
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updated VIF entry in instance network info cache for port c2ad5c36-9639-489d-8106-02c283822b7a. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:26 user nova-compute[75734]: INFO nova.compute.resource_tracker [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating resource usage from migration 1488b896-304b-4430-9cfd-b8af84b1c740
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-316f9dfc-b272-4fbf-8758-2afde05438be req-1c72b6b2-11e6-42f0-9d84-eaf258120fd7 service nova] Releasing lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Successfully updated port: 6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "refresh_cache-d886f816-fd98-41ad-8bdc-efb5b0baa131" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquired lock "refresh_cache-d886f816-fd98-41ad-8bdc-efb5b0baa131" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received event network-changed-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Refreshing instance network info cache due to event network-changed-6b4351bd-4646-451c-9c0b-3f2a748f1853. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] Acquiring lock "refresh_cache-d886f816-fd98-41ad-8bdc-efb5b0baa131" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.471s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:26 user nova-compute[75734]: INFO nova.compute.manager [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Migrating
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquired lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:11:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Updating instance_info_cache with network_info: [{"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Releasing lock "refresh_cache-d886f816-fd98-41ad-8bdc-efb5b0baa131" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Instance network_info: |[{"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] Acquired lock "refresh_cache-d886f816-fd98-41ad-8bdc-efb5b0baa131" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Refreshing network info cache for port 6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Start _get_guest_xml network_info=[{"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:11:27 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:27 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1934405528',display_name='tempest-VolumesActionsTest-instance-1934405528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1934405528',id=33,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f32f21ea574502bb22f0c65e02307c',ramdisk_id='',reservation_id='r-jhi34jwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-233001274',owner_user_name='tempest-VolumesActionsTest-233001274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:11:25Z,user_data=None,user_id='9e4416aa9b484a609622819875bbd32b',uuid=d886f816-fd98-41ad-8bdc-efb5b0baa131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converting VIF {"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:11,bridge_name='br-int',has_traffic_filtering=True,id=6b4351bd-4646-451c-9c0b-3f2a748f1853,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4351bd-46') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lazy-loading 'pci_devices' on Instance uuid d886f816-fd98-41ad-8bdc-efb5b0baa131 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:11:27 user nova-compute[75734]:   <uuid>d886f816-fd98-41ad-8bdc-efb5b0baa131</uuid>
Nov 22 16:11:27 user nova-compute[75734]:   <name>instance-00000021</name>
Nov 22 16:11:27 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:11:27 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:11:27 user nova-compute[75734]:   <metadata>
Nov 22 16:11:27 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:11:27 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:11:27 user nova-compute[75734]:       <nova:name>tempest-VolumesActionsTest-instance-1934405528</nova:name>
Nov 22 16:11:27 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:11:27</nova:creationTime>
Nov 22 16:11:27 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:11:27 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:11:27 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:11:27 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:11:27 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:11:27 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:11:27 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:11:27 user nova-compute[75734]:       <nova:owner>
Nov 22 16:11:27 user nova-compute[75734]:         <nova:user uuid="9e4416aa9b484a609622819875bbd32b">tempest-VolumesActionsTest-233001274-project-member</nova:user>
Nov 22 16:11:27 user nova-compute[75734]:         <nova:project uuid="f7f32f21ea574502bb22f0c65e02307c">tempest-VolumesActionsTest-233001274</nova:project>
Nov 22 16:11:27 user nova-compute[75734]:       </nova:owner>
Nov 22 16:11:27 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:11:27 user nova-compute[75734]:       <nova:ports>
Nov 22 16:11:27 user nova-compute[75734]:         <nova:port uuid="6b4351bd-4646-451c-9c0b-3f2a748f1853">
Nov 22 16:11:27 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 16:11:27 user nova-compute[75734]:         </nova:port>
Nov 22 16:11:27 user nova-compute[75734]:       </nova:ports>
Nov 22 16:11:27 user nova-compute[75734]:     </nova:instance>
Nov 22 16:11:27 user nova-compute[75734]:   </metadata>
Nov 22 16:11:27 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:11:27 user nova-compute[75734]:     <system>
Nov 22 16:11:27 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:11:27 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:11:27 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:11:27 user nova-compute[75734]:       <entry name="serial">d886f816-fd98-41ad-8bdc-efb5b0baa131</entry>
Nov 22 16:11:27 user nova-compute[75734]:       <entry name="uuid">d886f816-fd98-41ad-8bdc-efb5b0baa131</entry>
Nov 22 16:11:27 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:11:27 user nova-compute[75734]:     </system>
Nov 22 16:11:27 user nova-compute[75734]:   </sysinfo>
Nov 22 16:11:27 user nova-compute[75734]:   <os>
Nov 22 16:11:27 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:11:27 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:11:27 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:11:27 user nova-compute[75734]:   </os>
Nov 22 16:11:27 user nova-compute[75734]:   <features>
Nov 22 16:11:27 user nova-compute[75734]:     <acpi/>
Nov 22 16:11:27 user nova-compute[75734]:     <apic/>
Nov 22 16:11:27 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:11:27 user nova-compute[75734]:   </features>
Nov 22 16:11:27 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:11:27 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:11:27 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:11:27 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:11:27 user nova-compute[75734]:   </clock>
Nov 22 16:11:27 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:11:27 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:11:27 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:11:27 user nova-compute[75734]:   </cpu>
Nov 22 16:11:27 user nova-compute[75734]:   <devices>
Nov 22 16:11:27 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:11:27 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:11:27 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk"/>
Nov 22 16:11:27 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:11:27 user nova-compute[75734]:     </disk>
Nov 22 16:11:27 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:11:27 user nova-compute[75734]:       <mac address="fa:16:3e:56:cb:11"/>
Nov 22 16:11:27 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:11:27 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:11:27 user nova-compute[75734]:       <target dev="tap6b4351bd-46"/>
Nov 22 16:11:27 user nova-compute[75734]:     </interface>
Nov 22 16:11:27 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:11:27 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/console.log" append="off"/>
Nov 22 16:11:27 user nova-compute[75734]:     </serial>
Nov 22 16:11:27 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:11:27 user nova-compute[75734]:     <video>
Nov 22 16:11:27 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:11:27 user nova-compute[75734]:     </video>
Nov 22 16:11:27 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:11:27 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:11:27 user nova-compute[75734]:     </rng>
Nov 22 16:11:27 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:11:27 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:11:27 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:11:27 user nova-compute[75734]:     </memballoon>
Nov 22 16:11:27 user nova-compute[75734]:   </devices>
Nov 22 16:11:27 user nova-compute[75734]: </domain>
Nov 22 16:11:27 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1934405528',display_name='tempest-VolumesActionsTest-instance-1934405528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1934405528',id=33,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f32f21ea574502bb22f0c65e02307c',ramdisk_id='',reservation_id='r-jhi34jwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-233001274',owner_user_name='tempest-VolumesActionsTest-233001274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:11:25Z,user_data=None,user_id='9e4416aa9b484a609622819875bbd32b',uuid=d886f816-fd98-41ad-8bdc-efb5b0baa131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converting VIF {"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:11,bridge_name='br-int',has_traffic_filtering=True,id=6b4351bd-4646-451c-9c0b-3f2a748f1853,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4351bd-46') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG os_vif [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:11,bridge_name='br-int',has_traffic_filtering=True,id=6b4351bd-4646-451c-9c0b-3f2a748f1853,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4351bd-46') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '627ce53a-9673-5397-afea-217245dc6ebe', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b4351bd-46, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b4351bd-46, col_values=(('qos', UUID('5a137667-afaa-4124-9446-4236c7b1d3d4')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b4351bd-46, col_values=(('external_ids', {'iface-id': '6b4351bd-4646-451c-9c0b-3f2a748f1853', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:cb:11', 'vm-uuid': 'd886f816-fd98-41ad-8bdc-efb5b0baa131'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: INFO os_vif [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:11,bridge_name='br-int',has_traffic_filtering=True,id=6b4351bd-4646-451c-9c0b-3f2a748f1853,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4351bd-46')
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] No VIF found with MAC fa:16:3e:56:cb:11, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Releasing lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Starting migrate_disk_and_power_off {{(pid=75734) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-be3dc2df-b8f6-4c4c-a1d7-b735f78b2919 req-882f1283-8825-4125-aca3-288d4116a98f service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-unplugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-be3dc2df-b8f6-4c4c-a1d7-b735f78b2919 req-882f1283-8825-4125-aca3-288d4116a98f service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-be3dc2df-b8f6-4c4c-a1d7-b735f78b2919 req-882f1283-8825-4125-aca3-288d4116a98f service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-be3dc2df-b8f6-4c4c-a1d7-b735f78b2919 req-882f1283-8825-4125-aca3-288d4116a98f service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-be3dc2df-b8f6-4c4c-a1d7-b735f78b2919 req-882f1283-8825-4125-aca3-288d4116a98f service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-unplugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:28 user nova-compute[75734]: WARNING nova.compute.manager [req-be3dc2df-b8f6-4c4c-a1d7-b735f78b2919 req-882f1283-8825-4125-aca3-288d4116a98f service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received unexpected event network-vif-unplugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with vm_state active and task_state resize_migrating.
Nov 22 16:11:28 user nova-compute[75734]: DEBUG nova.network.neutron [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Updated VIF entry in instance network info cache for port 6b4351bd-4646-451c-9c0b-3f2a748f1853. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG nova.network.neutron [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Updating instance_info_cache with network_info: [{"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8912db1f-baa1-45cf-a942-bc1e1b1099c5 req-b0f04df3-fc10-46a5-b2c9-12ec6e75a0d3 service nova] Releasing lock "refresh_cache-d886f816-fd98-41ad-8bdc-efb5b0baa131" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:29 user nova-compute[75734]: INFO nova.compute.manager [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Terminating instance
Nov 22 16:11:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance destroyed successfully.
Nov 22 16:11:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1617189345',display_name='tempest-ServerActionsTestOtherA-server-1617189345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1617189345',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:09:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-jv06e6lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=6252f7b5-0458-42d4-8747-dfe425918dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-851351445-network", "vif_mac": "fa:16:3e:23:0e:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-851351445-network", "vif_mac": "fa:16:3e:23:0e:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_vif [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ad5c36-96, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9dcd2524-93c6-4f1d-be26-d146bf33a8c6) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: INFO os_vif [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96')
Nov 22 16:11:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:11:29 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e312eac-1140-4466-8f70-fc5fe1b10b3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:11:29 user nova-compute[75734]: No targets found.
Nov 22 16:11:29 user nova-compute[75734]: iSNS:
Nov 22 16:11:29 user nova-compute[75734]: No targets found.
Nov 22 16:11:29 user nova-compute[75734]: STATIC:
Nov 22 16:11:29 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:11:29 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:11:29 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:11:29 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:11:29 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:11:29 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:11:29 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0
Nov 22 16:11:29 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:11:29 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:11:29 user nova-compute[75734]: FIRMWARE:
Nov 22 16:11:29 user nova-compute[75734]: No targets found.
Nov 22 16:11:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:11:29 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:11:29 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a5ef26-e4dd-46b7-84f5-07707292af2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b474b2-6bd2-4d31-b9f8-b0108ca46c04]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:29 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:29 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:29 user nova-compute[75734]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:29 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac732d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b'): ({'sde'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Removing single pathed devices sde {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1817419-7d96-4c31-b899-689b9317d787]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd7bf4e-7185-4481-b8c3-990accd1bdac]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flushing IO for device /dev/sde {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af6f240-e6ab-40d4-aff7-924e50644d81]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb49dd6c-db45-4e64-b9b5-b48d3137dcdc]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] SCSI volumes sde have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff2b6a-f0fa-4831-8ca8-03e287251789]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea74db-b97c-43a7-a320-b49a916d9dae]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]
Nov 22 16:11:29 user nova-compute[75734]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.
Nov 22 16:11:29 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4061f281-8612-4ddd-93ff-b6d7510ccfe6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== disconnect_volume: return (380ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Instance destroyed successfully.
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lazy-loading 'resources' on Instance uuid 82a9e313-f7b9-4288-8fa7-0b8d55a70957 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1616324435',display_name='tempest-TestServerVolumeAttachmentScenario-server-1616324435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1616324435',id=29,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUBeDrWHVkjGsYNXd/sThdrXSEHumPCYxN24EA6L5ytK+pvApZO9Ay8RNHnuiz73PlABB9rWzNte1HTOm+2AnpbmzCPw2GpeocY34fvNKL5HY6bzfqsnBHXUnAkEaPjgg==',key_name='tempest-keypair-105430493',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69b505b41b594e83a92d18fd185d07de',ramdisk_id='',reservation_id='r-63tmtnk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1780334771',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1780334771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:07:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597c8b8d69be41ed9805ebe54eacf56a',uuid=82a9e313-f7b9-4288-8fa7-0b8d55a70957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Converting VIF {"id": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "address": "fa:16:3e:04:19:9e", "network": {"id": "f4ba4655-de99-4a87-b386-965f13e87179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-578932262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69b505b41b594e83a92d18fd185d07de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6def8f4d-d8", "ovs_interfaceid": "6def8f4d-d8e9-4b33-813e-53ab26748d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:19:9e,bridge_name='br-int',has_traffic_filtering=True,id=6def8f4d-d8e9-4b33-813e-53ab26748d30,network=Network(f4ba4655-de99-4a87-b386-965f13e87179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6def8f4d-d8') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG os_vif [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:19:9e,bridge_name='br-int',has_traffic_filtering=True,id=6def8f4d-d8e9-4b33-813e-53ab26748d30,network=Network(f4ba4655-de99-4a87-b386-965f13e87179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6def8f4d-d8') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6def8f4d-d8, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eec7b1fa-23a9-40de-9ca9-61aa31c32ead) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: INFO os_vif [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:19:9e,bridge_name='br-int',has_traffic_filtering=True,id=6def8f4d-d8e9-4b33-813e-53ab26748d30,network=Network(f4ba4655-de99-4a87-b386-965f13e87179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6def8f4d-d8')
Nov 22 16:11:30 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Deleting instance files /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957_del
Nov 22 16:11:30 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Deletion of /opt/stack/data/nova/instances/82a9e313-f7b9-4288-8fa7-0b8d55a70957_del complete
Nov 22 16:11:30 user nova-compute[75734]: INFO nova.compute.manager [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:30 user nova-compute[75734]: WARNING nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received unexpected event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with vm_state active and task_state resize_migrating.
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-vif-unplugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] No waiting events found dispatching network-vif-unplugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-vif-unplugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Acquiring lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] No waiting events found dispatching network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:30 user nova-compute[75734]: WARNING nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received unexpected event network-vif-plugged-6def8f4d-d8e9-4b33-813e-53ab26748d30 for instance with vm_state active and task_state deleting.
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received event network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Acquiring lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] No waiting events found dispatching network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:30 user nova-compute[75734]: WARNING nova.compute.manager [req-656c9285-54fe-456c-98f8-0873db64400b req-ec3f8a84-30ea-4bfd-9377-25e233a5a56d service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received unexpected event network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 for instance with vm_state building and task_state spawning.
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Port c2ad5c36-9639-489d-8106-02c283822b7a binding to destination host user is already ACTIVE {{(pid=75734) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquired lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:31 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Took 1.46 seconds to deallocate network for instance.
Nov 22 16:11:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.compute.manager [req-281b182e-b154-4f3d-a036-f6a642e06239 req-1c59f9da-909b-48c0-bcb7-2fe885e09d06 service nova] [instance: 82a9e313-f7b9-4288-8fa7-0b8d55a70957] Received event network-vif-deleted-6def8f4d-d8e9-4b33-813e-53ab26748d30 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:11:31 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Instance spawned successfully.
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:11:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:11:32 user nova-compute[75734]: INFO nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 22 16:11:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:11:32 user nova-compute[75734]: INFO nova.compute.manager [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Took 7.90 seconds to build instance.
Nov 22 16:11:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cf936484-1b6a-4413-a11e-78ee20ff32bd tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.022s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:32 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Deleted allocations for instance 82a9e313-f7b9-4288-8fa7-0b8d55a70957
Nov 22 16:11:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f30c8338-965c-470d-ac94-31344ab6c356 tempest-TestServerVolumeAttachmentScenario-1780334771 tempest-TestServerVolumeAttachmentScenario-1780334771-project-member] Lock "82a9e313-f7b9-4288-8fa7-0b8d55a70957" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.287s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-e725fe6f-ed50-449c-8cbf-ba159a3b1af1 req-b2c337d9-492f-4390-b468-81e71ca331d6 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received event network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e725fe6f-ed50-449c-8cbf-ba159a3b1af1 req-b2c337d9-492f-4390-b468-81e71ca331d6 service nova] Acquiring lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e725fe6f-ed50-449c-8cbf-ba159a3b1af1 req-b2c337d9-492f-4390-b468-81e71ca331d6 service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e725fe6f-ed50-449c-8cbf-ba159a3b1af1 req-b2c337d9-492f-4390-b468-81e71ca331d6 service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-e725fe6f-ed50-449c-8cbf-ba159a3b1af1 req-b2c337d9-492f-4390-b468-81e71ca331d6 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] No waiting events found dispatching network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:32 user nova-compute[75734]: WARNING nova.compute.manager [req-e725fe6f-ed50-449c-8cbf-ba159a3b1af1 req-b2c337d9-492f-4390-b468-81e71ca331d6 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received unexpected event network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 for instance with vm_state active and task_state None.
Nov 22 16:11:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Releasing lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabc51d9-b3bc-41cd-9a03-1d395c0666c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9afcd6d-f18a-406d-bc7c-5de17a93b481]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d1705e-1d30-4751-9714-8ca1afdbf232]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec716cc-3e93-42ae-84ff-f48eb70c31b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:11:33 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:11:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc4751e-e74b-4bc0-a0c0-a467ef2f7391]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:11:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:11:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Starting finish_migration {{(pid=75734) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance directory exists: not creating {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 16:11:39 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Creating image(s)
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Ensure instance console log exists: /opt/stack/data/nova/instances/6252f7b5-0458-42d4-8747-dfe425918dec/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Start _get_guest_xml network_info=[{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-851351445-network", "vif_mac": "fa:16:3e:23:0e:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0e5b1fca-021c-4048-b486-f0a7c6e083af', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6252f7b5-0458-42d4-8747-dfe425918dec', 'attached_at': '2023-11-22T16:11:40.000000', 'detached_at': '', 'volume_id': '65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'serial': '65d80c36-68c3-46a2-8b5c-ff90cf51ea7b'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:11:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:11:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:11:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:11:39 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a21b6-52cd-4e62-babb-76ba1912a5be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:11:39 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aec45c-14ad-45e5-8359-f872bdd6f5be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b] added
Nov 22 16:11:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76296f0-ece2-41ee-8679-b017ed1e41cb]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb99821a-e0f4-4438-b25c-258082a848fa]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdfTHDor {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdfTHDor" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[29276fb9-04cb-4341-ab3d-fb73ab72eb6d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdfTHDor'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4350d2b-1774-4423-8455-422e5e4a995e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf970f9-6ca0-4249-b849-32f04a37bee3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:40 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:40 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[980e269b-5f06-41d3-9a4b-8ddac2c21020]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]
Nov 22 16:11:40 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.
Nov 22 16:11:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff1c29c-5821-4a91-b99b-3349d1bfcbfe]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e80ae9-3ae8-406b-a3d5-3c7d63baba4c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:40 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:40 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:40 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:40 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d009cdd-3118-4a3d-8a1b-e04dbdb2cea0]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26533363733343637', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533363733343637', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1617189345',display_name='tempest-ServerActionsTestOtherA-server-1617189345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1617189345',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:09:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-jv06e6lr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=6252f7b5-0458-42d4-8747-dfe425918dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-851351445-network", "vif_mac": "fa:16:3e:23:0e:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-851351445-network", "vif_mac": "fa:16:3e:23:0e:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:11:41 user nova-compute[75734]:   <uuid>6252f7b5-0458-42d4-8747-dfe425918dec</uuid>
Nov 22 16:11:41 user nova-compute[75734]:   <name>instance-0000001f</name>
Nov 22 16:11:41 user nova-compute[75734]:   <memory>2097152</memory>
Nov 22 16:11:41 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:11:41 user nova-compute[75734]:   <metadata>
Nov 22 16:11:41 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:11:41 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:11:41 user nova-compute[75734]:       <nova:name>tempest-ServerActionsTestOtherA-server-1617189345</nova:name>
Nov 22 16:11:41 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:11:39</nova:creationTime>
Nov 22 16:11:41 user nova-compute[75734]:       <nova:flavor name="m1.small">
Nov 22 16:11:41 user nova-compute[75734]:         <nova:memory>2048</nova:memory>
Nov 22 16:11:41 user nova-compute[75734]:         <nova:disk>20</nova:disk>
Nov 22 16:11:41 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:11:41 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:11:41 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:11:41 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:11:41 user nova-compute[75734]:       <nova:owner>
Nov 22 16:11:41 user nova-compute[75734]:         <nova:user uuid="e9891b862488466e8e46427bbd19f742">tempest-ServerActionsTestOtherA-2146149591-project-member</nova:user>
Nov 22 16:11:41 user nova-compute[75734]:         <nova:project uuid="82865952d35349ffa829cf563d829fbe">tempest-ServerActionsTestOtherA-2146149591</nova:project>
Nov 22 16:11:41 user nova-compute[75734]:       </nova:owner>
Nov 22 16:11:41 user nova-compute[75734]:       <nova:ports>
Nov 22 16:11:41 user nova-compute[75734]:         <nova:port uuid="c2ad5c36-9639-489d-8106-02c283822b7a">
Nov 22 16:11:41 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 16:11:41 user nova-compute[75734]:         </nova:port>
Nov 22 16:11:41 user nova-compute[75734]:       </nova:ports>
Nov 22 16:11:41 user nova-compute[75734]:     </nova:instance>
Nov 22 16:11:41 user nova-compute[75734]:   </metadata>
Nov 22 16:11:41 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:11:41 user nova-compute[75734]:     <system>
Nov 22 16:11:41 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:11:41 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:11:41 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:11:41 user nova-compute[75734]:       <entry name="serial">6252f7b5-0458-42d4-8747-dfe425918dec</entry>
Nov 22 16:11:41 user nova-compute[75734]:       <entry name="uuid">6252f7b5-0458-42d4-8747-dfe425918dec</entry>
Nov 22 16:11:41 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:11:41 user nova-compute[75734]:     </system>
Nov 22 16:11:41 user nova-compute[75734]:   </sysinfo>
Nov 22 16:11:41 user nova-compute[75734]:   <os>
Nov 22 16:11:41 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:11:41 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:11:41 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:11:41 user nova-compute[75734]:   </os>
Nov 22 16:11:41 user nova-compute[75734]:   <features>
Nov 22 16:11:41 user nova-compute[75734]:     <acpi/>
Nov 22 16:11:41 user nova-compute[75734]:     <apic/>
Nov 22 16:11:41 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:11:41 user nova-compute[75734]:   </features>
Nov 22 16:11:41 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:11:41 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:11:41 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:11:41 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:11:41 user nova-compute[75734]:   </clock>
Nov 22 16:11:41 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:11:41 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:11:41 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:11:41 user nova-compute[75734]:   </cpu>
Nov 22 16:11:41 user nova-compute[75734]:   <devices>
Nov 22 16:11:41 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:11:41 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:11:41 user nova-compute[75734]:       <source dev="/dev/sdc"/>
Nov 22 16:11:41 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:11:41 user nova-compute[75734]:       <serial>65d80c36-68c3-46a2-8b5c-ff90cf51ea7b</serial>
Nov 22 16:11:41 user nova-compute[75734]:     </disk>
Nov 22 16:11:41 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:11:41 user nova-compute[75734]:       <mac address="fa:16:3e:23:0e:32"/>
Nov 22 16:11:41 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:11:41 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:11:41 user nova-compute[75734]:       <target dev="tapc2ad5c36-96"/>
Nov 22 16:11:41 user nova-compute[75734]:     </interface>
Nov 22 16:11:41 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:11:41 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/6252f7b5-0458-42d4-8747-dfe425918dec/console.log" append="off"/>
Nov 22 16:11:41 user nova-compute[75734]:     </serial>
Nov 22 16:11:41 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:11:41 user nova-compute[75734]:     <video>
Nov 22 16:11:41 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:11:41 user nova-compute[75734]:     </video>
Nov 22 16:11:41 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:11:41 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:11:41 user nova-compute[75734]:     </rng>
Nov 22 16:11:41 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:11:41 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:11:41 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:11:41 user nova-compute[75734]:     </memballoon>
Nov 22 16:11:41 user nova-compute[75734]:   </devices>
Nov 22 16:11:41 user nova-compute[75734]: </domain>
Nov 22 16:11:41 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1617189345',display_name='tempest-ServerActionsTestOtherA-server-1617189345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1617189345',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:09:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-jv06e6lr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=6252f7b5-0458-42d4-8747-dfe425918dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-851351445-network", "vif_mac": "fa:16:3e:23:0e:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-851351445-network", "vif_mac": "fa:16:3e:23:0e:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG os_vif [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '261bff1c-3395-5798-9789-190d0941b8ea', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ad5c36-96, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2ad5c36-96, col_values=(('qos', UUID('61db4439-1057-4933-8e5e-87249675f367')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2ad5c36-96, col_values=(('external_ids', {'iface-id': 'c2ad5c36-9639-489d-8106-02c283822b7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:0e:32', 'vm-uuid': '6252f7b5-0458-42d4-8747-dfe425918dec'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:41 user nova-compute[75734]: INFO os_vif [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96')
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] No VIF found with MAC fa:16:3e:23:0e:32, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:11:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-f247ed81-f118-4a03-863a-ea89b5c02f13 req-15eb72d1-8740-44cf-b93e-1c465623ff45 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f247ed81-f118-4a03-863a-ea89b5c02f13 req-15eb72d1-8740-44cf-b93e-1c465623ff45 service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f247ed81-f118-4a03-863a-ea89b5c02f13 req-15eb72d1-8740-44cf-b93e-1c465623ff45 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f247ed81-f118-4a03-863a-ea89b5c02f13 req-15eb72d1-8740-44cf-b93e-1c465623ff45 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-f247ed81-f118-4a03-863a-ea89b5c02f13 req-15eb72d1-8740-44cf-b93e-1c465623ff45 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:42 user nova-compute[75734]: WARNING nova.compute.manager [req-f247ed81-f118-4a03-863a-ea89b5c02f13 req-15eb72d1-8740-44cf-b93e-1c465623ff45 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received unexpected event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with vm_state active and task_state resize_finish.
Nov 22 16:11:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:11:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance running successfully.
Nov 22 16:11:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Failed to set time: agent not configured {{(pid=75734) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 22 16:11:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4c48947c-bdcd-4ce3-aa66-7ba1423d434f tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] finish_migration finished successfully. {{(pid=75734) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 22 16:11:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-3753a89d-508d-48c1-8e46-50948b383cd9 req-42621f08-9743-4ad4-adcc-a59843b6702a service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3753a89d-508d-48c1-8e46-50948b383cd9 req-42621f08-9743-4ad4-adcc-a59843b6702a service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3753a89d-508d-48c1-8e46-50948b383cd9 req-42621f08-9743-4ad4-adcc-a59843b6702a service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3753a89d-508d-48c1-8e46-50948b383cd9 req-42621f08-9743-4ad4-adcc-a59843b6702a service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-3753a89d-508d-48c1-8e46-50948b383cd9 req-42621f08-9743-4ad4-adcc-a59843b6702a service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:44 user nova-compute[75734]: WARNING nova.compute.manager [req-3753a89d-508d-48c1-8e46-50948b383cd9 req-42621f08-9743-4ad4-adcc-a59843b6702a service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received unexpected event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with vm_state active and task_state resize_finish.
Nov 22 16:11:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:50 user nova-compute[75734]: INFO nova.compute.manager [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Terminating instance
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-6d07adcb-3f1f-4353-a4f1-f2f8795d23a1 req-4f0f2b6d-da7b-4a13-96e7-b1b5ead8bb6e service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d07adcb-3f1f-4353-a4f1-f2f8795d23a1 req-4f0f2b6d-da7b-4a13-96e7-b1b5ead8bb6e service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d07adcb-3f1f-4353-a4f1-f2f8795d23a1 req-4f0f2b6d-da7b-4a13-96e7-b1b5ead8bb6e service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d07adcb-3f1f-4353-a4f1-f2f8795d23a1 req-4f0f2b6d-da7b-4a13-96e7-b1b5ead8bb6e service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-6d07adcb-3f1f-4353-a4f1-f2f8795d23a1 req-4f0f2b6d-da7b-4a13-96e7-b1b5ead8bb6e service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.compute.manager [req-6d07adcb-3f1f-4353-a4f1-f2f8795d23a1 req-4f0f2b6d-da7b-4a13-96e7-b1b5ead8bb6e service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Instance destroyed successfully.
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'resources' on Instance uuid 635ef0b9-e96c-4d0d-8f62-4382ad2813b8 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-625597841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-625597841',id=11,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:58:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-1zztwyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:59:51Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=635ef0b9-e96c-4d0d-8f62-4382ad2813b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "f2745d29-485b-4942-afe7-cbfe620d3938", "address": "fa:16:3e:30:76:b0", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2745d29-48", "ovs_interfaceid": "f2745d29-485b-4942-afe7-cbfe620d3938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG os_vif [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2745d29-48, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15511b2d-c9ad-4014-9cfe-79deaceebba0) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:50 user nova-compute[75734]: INFO os_vif [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=f2745d29-485b-4942-afe7-cbfe620d3938,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2745d29-48')
Nov 22 16:11:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNtumXRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:11:50 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:11:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:11:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4722ee-ccc9-481b-bd79-0b1481541f8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:11:51 user nova-compute[75734]: No targets found.
Nov 22 16:11:51 user nova-compute[75734]: iSNS:
Nov 22 16:11:51 user nova-compute[75734]: No targets found.
Nov 22 16:11:51 user nova-compute[75734]: STATIC:
Nov 22 16:11:51 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf
Nov 22 16:11:51 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:11:51 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:11:51 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:11:51 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:11:51 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:11:51 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0
Nov 22 16:11:51 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:11:51 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:11:51 user nova-compute[75734]: FIRMWARE:
Nov 22 16:11:51 user nova-compute[75734]: No targets found.
Nov 22 16:11:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:11:51 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:11:51 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3732bf3-f00d-4fe9-bc91-e15c5a911581]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de78805-5346-40b2-8226-2a2dc357302e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:51 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:51 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf (non-flash)
Nov 22 16:11:51 user nova-compute[75734]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:11:51 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:11:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac732ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf'): ({'sdd'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Removing single pathed devices sdd {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd7e2a-9a53-46ee-aa00-e8ec115b43d7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e7f099-dbf9-48fc-8444-2904df4f2364]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Flushing IO for device /dev/sdd {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a3c80a-5e3d-46bc-823b-1128c43c29d9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3e05e2-0873-42bb-b551-8c1b1d8b2b88]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b49018-2360-42dd-8dbe-298b38c5884a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb18358e-af89-4ff6-93cf-d22206c588d0]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260]
Nov 22 16:11:51 user nova-compute[75734]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf, portal: 172.16.0.220,3260] successful.
Nov 22 16:11:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0823898-f136-4505-8853-c6cb928e2ecf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb8dd48-9512-4325-b58d-6f2be3ea067f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] <== disconnect_volume: return (348ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:11:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Deleting instance files /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8_del
Nov 22 16:11:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Deletion of /opt/stack/data/nova/instances/635ef0b9-e96c-4d0d-8f62-4382ad2813b8_del complete
Nov 22 16:11:51 user nova-compute[75734]: INFO nova.compute.manager [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 22 16:11:51 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:11:52 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Took 0.64 seconds to deallocate network for instance.
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-41f2281d-3c31-44fc-9b47-c6f20d57c0c2 req-2fe3bb6c-d12d-467b-813f-83d5a8a3c903 service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-deleted-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:52 user nova-compute[75734]: WARNING nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state deleting.
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:52 user nova-compute[75734]: WARNING nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state deleting.
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:52 user nova-compute[75734]: WARNING nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state deleting.
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-unplugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Acquiring lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] No waiting events found dispatching network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:11:52 user nova-compute[75734]: WARNING nova.compute.manager [req-9e6a933e-e7c7-4a71-adb9-4fd8ac82f4e2 req-96e7168f-2adb-40a8-ae5f-fbc7bafb0aea service nova] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Received unexpected event network-vif-plugged-f2745d29-485b-4942-afe7-cbfe620d3938 for instance with vm_state active and task_state deleting.
Nov 22 16:11:52 user nova-compute[75734]: INFO nova.compute.manager [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: 635ef0b9-e96c-4d0d-8f62-4382ad2813b8] Took 0.82 seconds to detach 1 volumes for instance.
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:53 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:11:53 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:11:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:53 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Deleted allocations for instance 635ef0b9-e96c-4d0d-8f62-4382ad2813b8
Nov 22 16:11:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d51e42f-c852-4338-a9c7-5d2caa336834 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "635ef0b9-e96c-4d0d-8f62-4382ad2813b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.389s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:11:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:11:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:58 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:11:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:01 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:12:01 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8120MB free_disk=24.958694458007812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Applying migration context for instance 6252f7b5-0458-42d4-8747-dfe425918dec as it has an incoming, in-progress migration 1488b896-304b-4430-9cfd-b8af84b1c740. Migration status is finished {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 16:12:01 user nova-compute[75734]: INFO nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating resource usage from migration 1488b896-304b-4430-9cfd-b8af84b1c740
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc118db4-cb7d-4887-80c8-853f3f76a33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance d886f816-fd98-41ad-8bdc-efb5b0baa131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Migration 1488b896-304b-4430-9cfd-b8af84b1c740 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 6252f7b5-0458-42d4-8747-dfe425918dec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:12:01 user nova-compute[75734]: INFO nova.compute.claims [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Claim successful on node user
Nov 22 16:12:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:12:01 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:12:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.policy [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '034f9dedcf294f7093e65368c74abb47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866f8883870d4feebe60b3fb3031f8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:12:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Creating image(s)
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "/opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "/opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "/opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk 1073741824" returned: 0 in 0.051s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Skipping network cache update for instance because it is Building. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.206s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Successfully created port: dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid fc118db4-cb7d-4887-80c8-853f3f76a33a {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Cannot resize image /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Ensure instance console log exists: /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [{"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-fc118db4-cb7d-4887-80c8-853f3f76a33a" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Successfully updated port: dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquired lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-changed-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Refreshing instance network info cache due to event network-changed-dcee886a-49b7-49b4-bae3-2a444a1eb6a3. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] Acquiring lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:12:03 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Updating instance_info_cache with network_info: [{"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Releasing lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Instance network_info: |[{"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] Acquired lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Refreshing network info cache for port dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Start _get_guest_xml network_info=[{"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:12:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:12:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427174366',display_name='tempest-VolumesSnapshotTestJSON-instance-427174366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427174366',id=34,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECmXcVONce/eNh/mqesmyJV+qI22Ld2K6BOmeyXRdqdLYWJRFXAWA/0/Nxq8RZckBpVYCjbI2Isai/kcB6W/jhBt6bcGB5C1lXgxqGkfHWLhYlmnYXGk6OKGnCmbYdyOQ==',key_name='tempest-keypair-1144764740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='866f8883870d4feebe60b3fb3031f8d3',ramdisk_id='',reservation_id='r-0e2fjx0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1189754321',owner_user_name='tempest-VolumesSnapshotTestJSON-1189754321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='034f9dedcf294f7093e65368c74abb47',uuid=8439e175-5746-40c7-b0ee-aeb1a636ace6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converting VIF {"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:0e,bridge_name='br-int',has_traffic_filtering=True,id=dcee886a-49b7-49b4-bae3-2a444a1eb6a3,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcee886a-49') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'pci_devices' on Instance uuid 8439e175-5746-40c7-b0ee-aeb1a636ace6 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:12:04 user nova-compute[75734]:   <uuid>8439e175-5746-40c7-b0ee-aeb1a636ace6</uuid>
Nov 22 16:12:04 user nova-compute[75734]:   <name>instance-00000022</name>
Nov 22 16:12:04 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:12:04 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:12:04 user nova-compute[75734]:   <metadata>
Nov 22 16:12:04 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:12:04 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:12:04 user nova-compute[75734]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-427174366</nova:name>
Nov 22 16:12:04 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:12:04</nova:creationTime>
Nov 22 16:12:04 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:12:04 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:12:04 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:12:04 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:12:04 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:12:04 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:12:04 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:12:04 user nova-compute[75734]:       <nova:owner>
Nov 22 16:12:04 user nova-compute[75734]:         <nova:user uuid="034f9dedcf294f7093e65368c74abb47">tempest-VolumesSnapshotTestJSON-1189754321-project-member</nova:user>
Nov 22 16:12:04 user nova-compute[75734]:         <nova:project uuid="866f8883870d4feebe60b3fb3031f8d3">tempest-VolumesSnapshotTestJSON-1189754321</nova:project>
Nov 22 16:12:04 user nova-compute[75734]:       </nova:owner>
Nov 22 16:12:04 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:12:04 user nova-compute[75734]:       <nova:ports>
Nov 22 16:12:04 user nova-compute[75734]:         <nova:port uuid="dcee886a-49b7-49b4-bae3-2a444a1eb6a3">
Nov 22 16:12:04 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:12:04 user nova-compute[75734]:         </nova:port>
Nov 22 16:12:04 user nova-compute[75734]:       </nova:ports>
Nov 22 16:12:04 user nova-compute[75734]:     </nova:instance>
Nov 22 16:12:04 user nova-compute[75734]:   </metadata>
Nov 22 16:12:04 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:12:04 user nova-compute[75734]:     <system>
Nov 22 16:12:04 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:12:04 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:12:04 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:12:04 user nova-compute[75734]:       <entry name="serial">8439e175-5746-40c7-b0ee-aeb1a636ace6</entry>
Nov 22 16:12:04 user nova-compute[75734]:       <entry name="uuid">8439e175-5746-40c7-b0ee-aeb1a636ace6</entry>
Nov 22 16:12:04 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:12:04 user nova-compute[75734]:     </system>
Nov 22 16:12:04 user nova-compute[75734]:   </sysinfo>
Nov 22 16:12:04 user nova-compute[75734]:   <os>
Nov 22 16:12:04 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:12:04 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:12:04 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:12:04 user nova-compute[75734]:   </os>
Nov 22 16:12:04 user nova-compute[75734]:   <features>
Nov 22 16:12:04 user nova-compute[75734]:     <acpi/>
Nov 22 16:12:04 user nova-compute[75734]:     <apic/>
Nov 22 16:12:04 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:12:04 user nova-compute[75734]:   </features>
Nov 22 16:12:04 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:12:04 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:12:04 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:12:04 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:12:04 user nova-compute[75734]:   </clock>
Nov 22 16:12:04 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:12:04 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:12:04 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:12:04 user nova-compute[75734]:   </cpu>
Nov 22 16:12:04 user nova-compute[75734]:   <devices>
Nov 22 16:12:04 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:12:04 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:12:04 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk"/>
Nov 22 16:12:04 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:12:04 user nova-compute[75734]:     </disk>
Nov 22 16:12:04 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:12:04 user nova-compute[75734]:       <mac address="fa:16:3e:62:78:0e"/>
Nov 22 16:12:04 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:12:04 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:12:04 user nova-compute[75734]:       <target dev="tapdcee886a-49"/>
Nov 22 16:12:04 user nova-compute[75734]:     </interface>
Nov 22 16:12:04 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:12:04 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/console.log" append="off"/>
Nov 22 16:12:04 user nova-compute[75734]:     </serial>
Nov 22 16:12:04 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:12:04 user nova-compute[75734]:     <video>
Nov 22 16:12:04 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:12:04 user nova-compute[75734]:     </video>
Nov 22 16:12:04 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:12:04 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:12:04 user nova-compute[75734]:     </rng>
Nov 22 16:12:04 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:12:04 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:12:04 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:12:04 user nova-compute[75734]:     </memballoon>
Nov 22 16:12:04 user nova-compute[75734]:   </devices>
Nov 22 16:12:04 user nova-compute[75734]: </domain>
Nov 22 16:12:04 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427174366',display_name='tempest-VolumesSnapshotTestJSON-instance-427174366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427174366',id=34,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECmXcVONce/eNh/mqesmyJV+qI22Ld2K6BOmeyXRdqdLYWJRFXAWA/0/Nxq8RZckBpVYCjbI2Isai/kcB6W/jhBt6bcGB5C1lXgxqGkfHWLhYlmnYXGk6OKGnCmbYdyOQ==',key_name='tempest-keypair-1144764740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='866f8883870d4feebe60b3fb3031f8d3',ramdisk_id='',reservation_id='r-0e2fjx0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1189754321',owner_user_name='tempest-VolumesSnapshotTestJSON-1189754321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='034f9dedcf294f7093e65368c74abb47',uuid=8439e175-5746-40c7-b0ee-aeb1a636ace6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converting VIF {"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:0e,bridge_name='br-int',has_traffic_filtering=True,id=dcee886a-49b7-49b4-bae3-2a444a1eb6a3,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcee886a-49') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG os_vif [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:0e,bridge_name='br-int',has_traffic_filtering=True,id=dcee886a-49b7-49b4-bae3-2a444a1eb6a3,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcee886a-49') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc8cd47b-d5e5-5002-bc0d-01ff78e6fafd', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcee886a-49, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcee886a-49, col_values=(('qos', UUID('d85d0b32-7002-48bd-8fd4-747d3a5a9a1b')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcee886a-49, col_values=(('external_ids', {'iface-id': 'dcee886a-49b7-49b4-bae3-2a444a1eb6a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:78:0e', 'vm-uuid': '8439e175-5746-40c7-b0ee-aeb1a636ace6'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:04 user nova-compute[75734]: INFO os_vif [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:0e,bridge_name='br-int',has_traffic_filtering=True,id=dcee886a-49b7-49b4-bae3-2a444a1eb6a3,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcee886a-49')
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No VIF found with MAC fa:16:3e:62:78:0e, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Updated VIF entry in instance network info cache for port dcee886a-49b7-49b4-bae3-2a444a1eb6a3. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG nova.network.neutron [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Updating instance_info_cache with network_info: [{"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:12:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1bc0d3d0-a266-403a-9256-cf5007a436ee req-2017a8e9-d0ac-4ecf-a769-375c6f918277 service nova] Releasing lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-080ee97e-6938-4178-a2ec-063293ff907a req-e498a115-fbb5-4624-89c5-cb158a28eed3 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-080ee97e-6938-4178-a2ec-063293ff907a req-e498a115-fbb5-4624-89c5-cb158a28eed3 service nova] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-080ee97e-6938-4178-a2ec-063293ff907a req-e498a115-fbb5-4624-89c5-cb158a28eed3 service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-080ee97e-6938-4178-a2ec-063293ff907a req-e498a115-fbb5-4624-89c5-cb158a28eed3 service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-080ee97e-6938-4178-a2ec-063293ff907a req-e498a115-fbb5-4624-89c5-cb158a28eed3 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] No waiting events found dispatching network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:12:05 user nova-compute[75734]: WARNING nova.compute.manager [req-080ee97e-6938-4178-a2ec-063293ff907a req-e498a115-fbb5-4624-89c5-cb158a28eed3 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received unexpected event network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 for instance with vm_state building and task_state spawning.
Nov 22 16:12:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:12:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Instance spawned successfully.
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-3df24f36-869e-4d2a-bda6-344405dfff33 req-4bc426a9-dab7-45cc-b5e9-9cd91fb534d5 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3df24f36-869e-4d2a-bda6-344405dfff33 req-4bc426a9-dab7-45cc-b5e9-9cd91fb534d5 service nova] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3df24f36-869e-4d2a-bda6-344405dfff33 req-4bc426a9-dab7-45cc-b5e9-9cd91fb534d5 service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3df24f36-869e-4d2a-bda6-344405dfff33 req-4bc426a9-dab7-45cc-b5e9-9cd91fb534d5 service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-3df24f36-869e-4d2a-bda6-344405dfff33 req-4bc426a9-dab7-45cc-b5e9-9cd91fb534d5 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] No waiting events found dispatching network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:12:07 user nova-compute[75734]: WARNING nova.compute.manager [req-3df24f36-869e-4d2a-bda6-344405dfff33 req-4bc426a9-dab7-45cc-b5e9-9cd91fb534d5 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received unexpected event network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 for instance with vm_state building and task_state spawning.
Nov 22 16:12:07 user nova-compute[75734]: INFO nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 22 16:12:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:12:07 user nova-compute[75734]: INFO nova.compute.manager [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Took 6.44 seconds to build instance.
Nov 22 16:12:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1bf15ef3-482d-4b95-89e1-6e6529ad6b88 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.540s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-changed-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Refreshing instance network info cache due to event network-changed-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] Acquiring lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] Acquired lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Refreshing network info cache for port 76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updated VIF entry in instance network info cache for port 76164a7b-eac4-4f33-8fd3-b2cb72d68bcc. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updating instance_info_cache with network_info: [{"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:12:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5f294aa0-5645-4470-b568-be423d37edd7 req-0cc4d542-916f-4154-b5a3-2b59957e2c9d service nova] Releasing lock "refresh_cache-522e8f05-a119-4f0b-8e02-eb90e9fce744" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:12:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:20 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid 522e8f05-a119-4f0b-8e02-eb90e9fce744 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:12:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:21 user nova-compute[75734]: INFO nova.compute.manager [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Attaching volume 9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 to /dev/vdb
Nov 22 16:12:21 user nova-compute[75734]: DEBUG os_brick.utils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d9f4be-0887-442a-b79b-96dfb44f3c9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f04fd-77f3-46bc-b6ee-30184ee9ea07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[732b69dc-e796-425c-9033-c2e39bb6abb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[76138c00-3341-4e28-9c65-7ba9b5d2ad78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:12:21 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:12:21 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d3953-0ab2-423c-aca2-13e894610623]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG os_brick.utils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updating existing volume attachment record: 4ea5c57e-b352-4530-91dd-46f043ec9965 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:12:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOzNuYkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:12:30 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:12:30 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:12:30 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4fab96-fe16-4981-bf69-5a479deb80cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:12:30 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8bda0d-2404-43d8-8dbf-8ecac098d9b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629] added
Nov 22 16:12:30 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2c436d-5f12-4b1b-833e-018f1593d73b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6bceb-0e5b-4542-a58d-8ddf030ddc87]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOzNuYkC {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOzNuYkC" returned: 0 in 0.049s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e849a8fa-e700-4f81-ba89-c57b5b185322]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOzNuYkC'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[49481245-6e13-4e09-96f0-aa504d5b2fc4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c2eb2b-73eb-47c0-870e-092f2d9ef387]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:31 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:31 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e9b06-0766-45f4-9664-ac9849c1d54e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260]
Nov 22 16:12:31 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260] successful.
Nov 22 16:12:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0633a6-1483-4c65-a52e-e4288c9969ef]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fecd27c-9db7-4088-88c9-a3c964c5dbd8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:31 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:31 user nova-compute[75734]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 (non-flash)
Nov 22 16:12:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:31 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:31 user nova-compute[75734]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 (non-flash)
Nov 22 16:12:31 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e5a617-2cb5-4ccf-b80f-b1841d14d8ac]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOzNuYkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:12:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23039613430363238', 'path': '/dev/sdd'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039613430363238', 'path': '/dev/sdd'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG nova.objects.instance [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid 522e8f05-a119-4f0b-8e02-eb90e9fce744 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:12:32 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:12:32 user nova-compute[75734]:   <source dev="/dev/sdd"/>
Nov 22 16:12:32 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:12:32 user nova-compute[75734]:   <serial>9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629</serial>
Nov 22 16:12:32 user nova-compute[75734]: </disk>
Nov 22 16:12:32 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] No VIF found with MAC fa:16:3e:4a:9e:34, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:12:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-1534eb7f-3abe-4e45-ba47-d3a36fb51639 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.810s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:34 user nova-compute[75734]: INFO nova.compute.manager [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Detaching volume 9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629
Nov 22 16:12:34 user nova-compute[75734]: INFO nova.virt.block_device [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Attempting to driver detach volume 9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 from mountpoint /dev/vdb
Nov 22 16:12:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Attempting to detach device vdb from instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:12:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:12:34 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:12:34 user nova-compute[75734]:   <source dev="/dev/sdd"/>
Nov 22 16:12:34 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:12:34 user nova-compute[75734]:   <serial>9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629</serial>
Nov 22 16:12:34 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:12:34 user nova-compute[75734]: </disk>
Nov 22 16:12:34 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:12:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully detached device vdb from instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 from the persistent domain config.
Nov 22 16:12:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:12:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:12:34 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:12:34 user nova-compute[75734]:   <source dev="/dev/sdd"/>
Nov 22 16:12:34 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:12:34 user nova-compute[75734]:   <serial>9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629</serial>
Nov 22 16:12:34 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:12:34 user nova-compute[75734]: </disk>
Nov 22 16:12:34 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:12:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:12:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:38 user nova-compute[75734]: INFO nova.compute.manager [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Detaching volume 8505e510-b813-4d8b-973e-c886ceb416f0
Nov 22 16:12:38 user nova-compute[75734]: INFO nova.virt.block_device [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Attempting to driver detach volume 8505e510-b813-4d8b-973e-c886ceb416f0 from mountpoint /dev/vdc
Nov 22 16:12:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Attempting to detach device vdc from instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:12:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:12:38 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:12:38 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:12:38 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:12:38 user nova-compute[75734]:   <serial>8505e510-b813-4d8b-973e-c886ceb416f0</serial>
Nov 22 16:12:38 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:12:38 user nova-compute[75734]: </disk>
Nov 22 16:12:38 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:12:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully detached device vdc from instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 from the persistent domain config.
Nov 22 16:12:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:12:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:12:38 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:12:38 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:12:38 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:12:38 user nova-compute[75734]:   <serial>8505e510-b813-4d8b-973e-c886ceb416f0</serial>
Nov 22 16:12:38 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:12:38 user nova-compute[75734]: </disk>
Nov 22 16:12:38 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:12:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:41 user nova-compute[75734]: INFO nova.compute.manager [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Terminating instance
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-fdc9500f-25b6-4de5-a86e-45efffd23c88 req-59e3046c-b108-4a34-9319-c1e998b3b58e service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received event network-vif-unplugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fdc9500f-25b6-4de5-a86e-45efffd23c88 req-59e3046c-b108-4a34-9319-c1e998b3b58e service nova] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fdc9500f-25b6-4de5-a86e-45efffd23c88 req-59e3046c-b108-4a34-9319-c1e998b3b58e service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fdc9500f-25b6-4de5-a86e-45efffd23c88 req-59e3046c-b108-4a34-9319-c1e998b3b58e service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-fdc9500f-25b6-4de5-a86e-45efffd23c88 req-59e3046c-b108-4a34-9319-c1e998b3b58e service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] No waiting events found dispatching network-vif-unplugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-fdc9500f-25b6-4de5-a86e-45efffd23c88 req-59e3046c-b108-4a34-9319-c1e998b3b58e service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received event network-vif-unplugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Instance destroyed successfully.
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.objects.instance [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lazy-loading 'resources' on Instance uuid fc118db4-cb7d-4887-80c8-853f3f76a33a {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-398780676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-398780676',id=3,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='234cf12714b74b12aa027c8fff2e784e',ramdisk_id='',reservation_id='r-kal00u5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:55:00Z,user_data=None,user_id='5dc99ff4c7054545a10673afb2cf930b',uuid=fc118db4-cb7d-4887-80c8-853f3f76a33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converting VIF {"id": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "address": "fa:16:3e:b7:ca:f8", "network": {"id": "78f1729f-368e-4ed3-98d2-5c82021e9e4d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1594981478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "234cf12714b74b12aa027c8fff2e784e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbe108-ae", "ovs_interfaceid": "48dbe108-ae0a-4b53-9b51-e28eacc21970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ca:f8,bridge_name='br-int',has_traffic_filtering=True,id=48dbe108-ae0a-4b53-9b51-e28eacc21970,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbe108-ae') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG os_vif [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ca:f8,bridge_name='br-int',has_traffic_filtering=True,id=48dbe108-ae0a-4b53-9b51-e28eacc21970,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbe108-ae') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48dbe108-ae, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ffc2991-2522-46c0-83b7-8b5d1ee5699c) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:41 user nova-compute[75734]: INFO os_vif [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ca:f8,bridge_name='br-int',has_traffic_filtering=True,id=48dbe108-ae0a-4b53-9b51-e28eacc21970,network=Network(78f1729f-368e-4ed3-98d2-5c82021e9e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbe108-ae')
Nov 22 16:12:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Deleting instance files /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a_del
Nov 22 16:12:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Deletion of /opt/stack/data/nova/instances/fc118db4-cb7d-4887-80c8-853f3f76a33a_del complete
Nov 22 16:12:41 user nova-compute[75734]: INFO nova.compute.manager [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 22 16:12:41 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:12:41 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:12:42 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Took 0.47 seconds to deallocate network for instance.
Nov 22 16:12:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-76fb41c4-a471-425a-b693-9f01fbfb4660 req-36320223-942d-466c-be68-d0d5c6cc935a service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received event network-vif-deleted-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:12:42 user nova-compute[75734]: INFO nova.compute.manager [req-76fb41c4-a471-425a-b693-9f01fbfb4660 req-36320223-942d-466c-be68-d0d5c6cc935a service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Neutron deleted interface 48dbe108-ae0a-4b53-9b51-e28eacc21970; detaching it from the instance and deleting it from the info cache
Nov 22 16:12:42 user nova-compute[75734]: DEBUG nova.network.neutron [req-76fb41c4-a471-425a-b693-9f01fbfb4660 req-36320223-942d-466c-be68-d0d5c6cc935a service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-76fb41c4-a471-425a-b693-9f01fbfb4660 req-36320223-942d-466c-be68-d0d5c6cc935a service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Detach interface failed, port_id=48dbe108-ae0a-4b53-9b51-e28eacc21970, reason: Instance fc118db4-cb7d-4887-80c8-853f3f76a33a could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:12:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:42 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Deleted allocations for instance fc118db4-cb7d-4887-80c8-853f3f76a33a
Nov 22 16:12:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d118b09c-0288-42f4-988f-43ca7040fbf9 tempest-ServerBootFromVolumeStableRescueTest-1333150873 tempest-ServerBootFromVolumeStableRescueTest-1333150873-project-member] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-fd7ea515-aa70-4758-88d4-17eb9ed1cb20 req-769a082a-7d04-4c94-a663-fe3f66ad98b8 service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received event network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:12:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fd7ea515-aa70-4758-88d4-17eb9ed1cb20 req-769a082a-7d04-4c94-a663-fe3f66ad98b8 service nova] Acquiring lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:12:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fd7ea515-aa70-4758-88d4-17eb9ed1cb20 req-769a082a-7d04-4c94-a663-fe3f66ad98b8 service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:12:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fd7ea515-aa70-4758-88d4-17eb9ed1cb20 req-769a082a-7d04-4c94-a663-fe3f66ad98b8 service nova] Lock "fc118db4-cb7d-4887-80c8-853f3f76a33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-fd7ea515-aa70-4758-88d4-17eb9ed1cb20 req-769a082a-7d04-4c94-a663-fe3f66ad98b8 service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] No waiting events found dispatching network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:12:43 user nova-compute[75734]: WARNING nova.compute.manager [req-fd7ea515-aa70-4758-88d4-17eb9ed1cb20 req-769a082a-7d04-4c94-a663-fe3f66ad98b8 service nova] [instance: fc118db4-cb7d-4887-80c8-853f3f76a33a] Received unexpected event network-vif-plugged-48dbe108-ae0a-4b53-9b51-e28eacc21970 for instance with vm_state deleted and task_state None.
Nov 22 16:12:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:55 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 is timed out.
Nov 22 16:12:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully detached device vdb from instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 from the live domain config.
Nov 22 16:12:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOzNuYkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:12:55 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e50a73-4ed4-455e-910f-e7ee38712fb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:12:55 user nova-compute[75734]: No targets found.
Nov 22 16:12:55 user nova-compute[75734]: iSNS:
Nov 22 16:12:55 user nova-compute[75734]: No targets found.
Nov 22 16:12:55 user nova-compute[75734]: STATIC:
Nov 22 16:12:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:12:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:12:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:12:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0
Nov 22 16:12:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:12:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:12:55 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629
Nov 22 16:12:55 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:12:55 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:12:55 user nova-compute[75734]: FIRMWARE:
Nov 22 16:12:55 user nova-compute[75734]: No targets found.
Nov 22 16:12:55 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:12:55 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:12:55 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a953d58b-e6ee-402e-81f8-d3204993ec9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e84846-3736-4cf4-b6ad-d00ea4a278f2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:55 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:55 user nova-compute[75734]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 (non-flash)
Nov 22 16:12:55 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:55 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:55 user nova-compute[75734]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 (non-flash)
Nov 22 16:12:55 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac5e56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629'): ({'sdd'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Removing single pathed devices sdd {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0806101-876d-4454-b631-3c015518b687]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[348355ea-d723-47ca-b9d3-ccbd778cf654]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Flushing IO for device /dev/sdd {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[22047164-e083-4e91-8596-91be8431d1f2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b3de5-a2d6-4870-9c54-9c9881125696]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aa6174-0dd9-4999-ad16-d651b39fb162]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d982c7d-d41d-4e82-b809-f7aef0486226]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260]
Nov 22 16:12:55 user nova-compute[75734]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629, portal: 172.16.0.220,3260] successful.
Nov 22 16:12:55 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7fd8ae-e2b1-4929-b0bd-d0985c7d7629 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[33908982-481d-44f4-8477-904db80774fa]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] <== disconnect_volume: return (264ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:12:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG nova.objects.instance [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'flavor' on Instance uuid 522e8f05-a119-4f0b-8e02-eb90e9fce744 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fc5a2560-9474-44a5-821e-40f0a0429d33 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:12:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:12:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 is timed out.
Nov 22 16:12:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully detached device vdc from instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 from the live domain config.
Nov 22 16:12:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTdfPMHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:12:59 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae5e0e-eedf-4ace-90dc-bf0daeaae94c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:12:59 user nova-compute[75734]: No targets found.
Nov 22 16:12:59 user nova-compute[75734]: iSNS:
Nov 22 16:12:59 user nova-compute[75734]: No targets found.
Nov 22 16:12:59 user nova-compute[75734]: STATIC:
Nov 22 16:12:59 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:12:59 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:12:59 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:12:59 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0
Nov 22 16:12:59 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:12:59 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:12:59 user nova-compute[75734]: FIRMWARE:
Nov 22 16:12:59 user nova-compute[75734]: No targets found.
Nov 22 16:12:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:12:59 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:12:59 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf6759-ae86-4fa2-9913-adbcecfbfe84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[963dd6f4-5e15-4c6a-a55d-10e12dc3490f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:59 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 (non-flash)
Nov 22 16:12:59 user nova-compute[75734]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:12:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7f3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5eb3fb-5084-44b1-9fe2-3ce0c0875d4f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb743f4a-4311-45af-9f90-0282a62b4fc2]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a07aca-2bd1-47d2-b852-d8e33168ea5d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fe9eff-bb78-4b07-a727-7107047196b2]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba14b4d-386b-4735-8f0a-0ac9c0855422]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ef176-afd6-4ac8-b3ac-4a2013782a4d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260]
Nov 22 16:12:59 user nova-compute[75734]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0, portal: 172.16.0.220,3260] successful.
Nov 22 16:12:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8505e510-b813-4d8b-973e-c886ceb416f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4b41f6-bda5-47bd-8ef1-fb45fcc969f3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] <== disconnect_volume: return (299ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:12:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'flavor' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-44c24b44-a45d-4ff3-934b-458969182996 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.622s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:13:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=25.036914825439453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Applying migration context for instance 6252f7b5-0458-42d4-8747-dfe425918dec as it has an incoming, in-progress migration 1488b896-304b-4430-9cfd-b8af84b1c740. Migration status is finished {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 16:13:03 user nova-compute[75734]: INFO nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating resource usage from migration 1488b896-304b-4430-9cfd-b8af84b1c740
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance d886f816-fd98-41ad-8bdc-efb5b0baa131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Migration 1488b896-304b-4430-9cfd-b8af84b1c740 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 6252f7b5-0458-42d4-8747-dfe425918dec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:13:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:13:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:13:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:13:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "d886f816-fd98-41ad-8bdc-efb5b0baa131" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:14 user nova-compute[75734]: INFO nova.compute.manager [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Terminating instance
Nov 22 16:13:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Going to confirm migration 2 {{(pid=75734) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-62af34ed-a940-419e-abcf-bbdfacc04dae req-14ace789-9d31-4f17-a228-c5f6904219d0 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received event network-vif-unplugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-62af34ed-a940-419e-abcf-bbdfacc04dae req-14ace789-9d31-4f17-a228-c5f6904219d0 service nova] Acquiring lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-62af34ed-a940-419e-abcf-bbdfacc04dae req-14ace789-9d31-4f17-a228-c5f6904219d0 service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-62af34ed-a940-419e-abcf-bbdfacc04dae req-14ace789-9d31-4f17-a228-c5f6904219d0 service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.compute.manager [req-62af34ed-a940-419e-abcf-bbdfacc04dae req-14ace789-9d31-4f17-a228-c5f6904219d0 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] No waiting events found dispatching network-vif-unplugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.compute.manager [req-62af34ed-a940-419e-abcf-bbdfacc04dae req-14ace789-9d31-4f17-a228-c5f6904219d0 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received event network-vif-unplugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquired lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.objects.instance [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'info_cache' on Instance uuid 6252f7b5-0458-42d4-8747-dfe425918dec {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:13:15 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Instance destroyed successfully.
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.objects.instance [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lazy-loading 'resources' on Instance uuid d886f816-fd98-41ad-8bdc-efb5b0baa131 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1934405528',display_name='tempest-VolumesActionsTest-instance-1934405528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1934405528',id=33,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f32f21ea574502bb22f0c65e02307c',ramdisk_id='',reservation_id='r-jhi34jwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-233001274',owner_user_name='tempest-VolumesActionsTest-233001274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:11:32Z,user_data=None,user_id='9e4416aa9b484a609622819875bbd32b',uuid=d886f816-fd98-41ad-8bdc-efb5b0baa131,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converting VIF {"id": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "address": "fa:16:3e:56:cb:11", "network": {"id": "5dfbdf78-d12c-4c63-a1f5-2b054d6ed188", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2186633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f32f21ea574502bb22f0c65e02307c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4351bd-46", "ovs_interfaceid": "6b4351bd-4646-451c-9c0b-3f2a748f1853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:11,bridge_name='br-int',has_traffic_filtering=True,id=6b4351bd-4646-451c-9c0b-3f2a748f1853,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4351bd-46') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG os_vif [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:11,bridge_name='br-int',has_traffic_filtering=True,id=6b4351bd-4646-451c-9c0b-3f2a748f1853,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4351bd-46') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b4351bd-46, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a137667-afaa-4124-9446-4236c7b1d3d4) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:15 user nova-compute[75734]: INFO os_vif [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:11,bridge_name='br-int',has_traffic_filtering=True,id=6b4351bd-4646-451c-9c0b-3f2a748f1853,network=Network(5dfbdf78-d12c-4c63-a1f5-2b054d6ed188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4351bd-46')
Nov 22 16:13:15 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Deleting instance files /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131_del
Nov 22 16:13:15 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Deletion of /opt/stack/data/nova/instances/d886f816-fd98-41ad-8bdc-efb5b0baa131_del complete
Nov 22 16:13:15 user nova-compute[75734]: INFO nova.compute.manager [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 22 16:13:15 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:13:15 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Releasing lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.objects.instance [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'migration_context' on Instance uuid 6252f7b5-0458-42d4-8747-dfe425918dec {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.objects.base [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Object Instance<6252f7b5-0458-42d4-8747-dfe425918dec> lazy-loaded attributes: info_cache,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:16 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Took 0.64 seconds to deallocate network for instance.
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-86de9b1e-c601-4d31-87cb-5006898e78d4 req-1c334311-b41c-4093-ae1e-92fae80f3066 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received event network-vif-deleted-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:16 user nova-compute[75734]: INFO nova.compute.manager [req-86de9b1e-c601-4d31-87cb-5006898e78d4 req-1c334311-b41c-4093-ae1e-92fae80f3066 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Neutron deleted interface 6b4351bd-4646-451c-9c0b-3f2a748f1853; detaching it from the instance and deleting it from the info cache
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-86de9b1e-c601-4d31-87cb-5006898e78d4 req-1c334311-b41c-4093-ae1e-92fae80f3066 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-86de9b1e-c601-4d31-87cb-5006898e78d4 req-1c334311-b41c-4093-ae1e-92fae80f3066 service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Detach interface failed, port_id=6b4351bd-4646-451c-9c0b-3f2a748f1853, reason: Instance d886f816-fd98-41ad-8bdc-efb5b0baa131 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.290s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.092s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:16 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Deleted allocation for migration 1488b896-304b-4430-9cfd-b8af84b1c740
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-21f1cedb-4131-4022-9598-bfae89661b05 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.804s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:16 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Deleted allocations for instance d886f816-fd98-41ad-8bdc-efb5b0baa131
Nov 22 16:13:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-78504e00-cf8f-4758-a824-ea3716a3808a tempest-VolumesActionsTest-233001274 tempest-VolumesActionsTest-233001274-project-member] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-2448532c-6405-4b64-a3f3-6891d1c32f3d req-a4df5a13-506d-4f25-b24c-01dd8749351d service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received event network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2448532c-6405-4b64-a3f3-6891d1c32f3d req-a4df5a13-506d-4f25-b24c-01dd8749351d service nova] Acquiring lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2448532c-6405-4b64-a3f3-6891d1c32f3d req-a4df5a13-506d-4f25-b24c-01dd8749351d service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2448532c-6405-4b64-a3f3-6891d1c32f3d req-a4df5a13-506d-4f25-b24c-01dd8749351d service nova] Lock "d886f816-fd98-41ad-8bdc-efb5b0baa131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-2448532c-6405-4b64-a3f3-6891d1c32f3d req-a4df5a13-506d-4f25-b24c-01dd8749351d service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] No waiting events found dispatching network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:13:17 user nova-compute[75734]: WARNING nova.compute.manager [req-2448532c-6405-4b64-a3f3-6891d1c32f3d req-a4df5a13-506d-4f25-b24c-01dd8749351d service nova] [instance: d886f816-fd98-41ad-8bdc-efb5b0baa131] Received unexpected event network-vif-plugged-6b4351bd-4646-451c-9c0b-3f2a748f1853 for instance with vm_state deleted and task_state None.
Nov 22 16:13:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:25 user nova-compute[75734]: INFO nova.compute.manager [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Terminating instance
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-1fac7a23-10f4-4adb-abc2-1a2e8b17889b req-af45364e-1828-49ef-bb95-ebccd83ac9cd service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-vif-unplugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1fac7a23-10f4-4adb-abc2-1a2e8b17889b req-af45364e-1828-49ef-bb95-ebccd83ac9cd service nova] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1fac7a23-10f4-4adb-abc2-1a2e8b17889b req-af45364e-1828-49ef-bb95-ebccd83ac9cd service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1fac7a23-10f4-4adb-abc2-1a2e8b17889b req-af45364e-1828-49ef-bb95-ebccd83ac9cd service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-1fac7a23-10f4-4adb-abc2-1a2e8b17889b req-af45364e-1828-49ef-bb95-ebccd83ac9cd service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] No waiting events found dispatching network-vif-unplugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-1fac7a23-10f4-4adb-abc2-1a2e8b17889b req-af45364e-1828-49ef-bb95-ebccd83ac9cd service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-vif-unplugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Instance destroyed successfully.
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.objects.instance [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lazy-loading 'resources' on Instance uuid 522e8f05-a119-4f0b-8e02-eb90e9fce744 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-111668328',display_name='tempest-AttachVolumeNegativeTest-server-111668328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-111668328',id=32,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkfwLgoOyf6LAiY0c46AVEim8ls+AeOLG/+Iz79hDsruzwsnX6QPjQAtGNY6e0UtbaGUQCZhZFVU2aPMrahZsNHf2blTBa8LYdwZUqasjMhbOnGOfMgmW30dJYssEVbhQ==',key_name='tempest-keypair-1497542988',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7d5b5135ca46c2a649df3c1ce2ac64',ramdisk_id='',reservation_id='r-2vtmpu7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2104845353',owner_user_name='tempest-AttachVolumeNegativeTest-2104845353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abb5b3c03bbb490f9ef6f3f9c70bf9d2',uuid=522e8f05-a119-4f0b-8e02-eb90e9fce744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converting VIF {"id": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "address": "fa:16:3e:4a:9e:34", "network": {"id": "6e7d727c-cf71-4940-b298-d1e6edb0714f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1993594973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7d5b5135ca46c2a649df3c1ce2ac64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76164a7b-ea", "ovs_interfaceid": "76164a7b-eac4-4f33-8fd3-b2cb72d68bcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:9e:34,bridge_name='br-int',has_traffic_filtering=True,id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76164a7b-ea') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG os_vif [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:9e:34,bridge_name='br-int',has_traffic_filtering=True,id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76164a7b-ea') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76164a7b-ea, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1554200d-2575-4435-805d-032c9daf2c3b) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:26 user nova-compute[75734]: INFO os_vif [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:9e:34,bridge_name='br-int',has_traffic_filtering=True,id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc,network=Network(6e7d727c-cf71-4940-b298-d1e6edb0714f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76164a7b-ea')
Nov 22 16:13:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Deleting instance files /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744_del
Nov 22 16:13:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Deletion of /opt/stack/data/nova/instances/522e8f05-a119-4f0b-8e02-eb90e9fce744_del complete
Nov 22 16:13:26 user nova-compute[75734]: INFO nova.compute.manager [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 22 16:13:26 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:26 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Took 0.64 seconds to deallocate network for instance.
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb775ef1-39af-42f4-a3f6-8bafa3962804 req-39d4bb72-c90e-4bed-b9a3-e836284a0422 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-vif-deleted-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:26 user nova-compute[75734]: INFO nova.compute.manager [req-bb775ef1-39af-42f4-a3f6-8bafa3962804 req-39d4bb72-c90e-4bed-b9a3-e836284a0422 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Neutron deleted interface 76164a7b-eac4-4f33-8fd3-b2cb72d68bcc; detaching it from the instance and deleting it from the info cache
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-bb775ef1-39af-42f4-a3f6-8bafa3962804 req-39d4bb72-c90e-4bed-b9a3-e836284a0422 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb775ef1-39af-42f4-a3f6-8bafa3962804 req-39d4bb72-c90e-4bed-b9a3-e836284a0422 service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Detach interface failed, port_id=76164a7b-eac4-4f33-8fd3-b2cb72d68bcc, reason: Instance 522e8f05-a119-4f0b-8e02-eb90e9fce744 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:13:26 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:13:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:27 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Deleted allocations for instance 522e8f05-a119-4f0b-8e02-eb90e9fce744
Nov 22 16:13:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-6aa7743f-4c24-4e1b-8035-c48e66169a21 tempest-AttachVolumeNegativeTest-2104845353 tempest-AttachVolumeNegativeTest-2104845353-project-member] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-9edaf05c-6f89-401b-a59a-bf386e7bf178 req-9dd82c33-dbae-4a81-800b-a54c332e6bcb service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received event network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9edaf05c-6f89-401b-a59a-bf386e7bf178 req-9dd82c33-dbae-4a81-800b-a54c332e6bcb service nova] Acquiring lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9edaf05c-6f89-401b-a59a-bf386e7bf178 req-9dd82c33-dbae-4a81-800b-a54c332e6bcb service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9edaf05c-6f89-401b-a59a-bf386e7bf178 req-9dd82c33-dbae-4a81-800b-a54c332e6bcb service nova] Lock "522e8f05-a119-4f0b-8e02-eb90e9fce744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-9edaf05c-6f89-401b-a59a-bf386e7bf178 req-9dd82c33-dbae-4a81-800b-a54c332e6bcb service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] No waiting events found dispatching network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:13:27 user nova-compute[75734]: WARNING nova.compute.manager [req-9edaf05c-6f89-401b-a59a-bf386e7bf178 req-9dd82c33-dbae-4a81-800b-a54c332e6bcb service nova] [instance: 522e8f05-a119-4f0b-8e02-eb90e9fce744] Received unexpected event network-vif-plugged-76164a7b-eac4-4f33-8fd3-b2cb72d68bcc for instance with vm_state deleted and task_state None.
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:29 user nova-compute[75734]: INFO nova.compute.manager [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Terminating instance
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-unplugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-unplugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-unplugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] Acquiring lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.compute.manager [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] No waiting events found dispatching network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:13:29 user nova-compute[75734]: WARNING nova.compute.manager [req-f8423950-c9ee-4308-8338-b91fefe5b2e7 req-fcc8f6ab-37ec-409a-8028-3a1c4bdea4dd service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received unexpected event network-vif-plugged-c5d05c23-c676-43f3-845f-bf210be313b2 for instance with vm_state active and task_state deleting.
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Instance destroyed successfully.
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.objects.instance [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'resources' on Instance uuid 0bb36614-4020-4eb5-81b3-f8e9a5f43541 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-620964655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-620964655',id=28,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmRWp0lXL5zod5s9sYt+qGZu5jWt0PCTA0Lz99UUZtBPolfaBx/0PgEMrfmNx63spio9CBxImcNyZ9sgtuvAJVMhrZSPXwEbGhUbTuC49SxVzf9SuCFPgZ69Y7Qjw8RA==',key_name='tempest-keypair-1677415622',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-dgsvht2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=0bb36614-4020-4eb5-81b3-f8e9a5f43541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "c5d05c23-c676-43f3-845f-bf210be313b2", "address": "fa:16:3e:1f:99:4f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5d05c23-c6", "ovs_interfaceid": "c5d05c23-c676-43f3-845f-bf210be313b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG os_vif [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5d05c23-c6, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08c7b1cd-26d4-4c8f-88d0-6324495de5d8) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:29 user nova-compute[75734]: INFO os_vif [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:99:4f,bridge_name='br-int',has_traffic_filtering=True,id=c5d05c23-c676-43f3-845f-bf210be313b2,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5d05c23-c6')
Nov 22 16:13:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Deleting instance files /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541_del
Nov 22 16:13:29 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Deletion of /opt/stack/data/nova/instances/0bb36614-4020-4eb5-81b3-f8e9a5f43541_del complete
Nov 22 16:13:29 user nova-compute[75734]: INFO nova.compute.manager [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 16:13:29 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:13:29 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:13:30 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:30 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Took 0.67 seconds to deallocate network for instance.
Nov 22 16:13:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-0d5fc7ce-2a50-46b7-b5ba-bf8bb95dd75f req-269fb3ad-2f94-45a9-a315-58315c891813 service nova] [instance: 0bb36614-4020-4eb5-81b3-f8e9a5f43541] Received event network-vif-deleted-c5d05c23-c676-43f3-845f-bf210be313b2 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:30 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:13:30 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:13:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:30 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Deleted allocations for instance 0bb36614-4020-4eb5-81b3-f8e9a5f43541
Nov 22 16:13:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-955aac10-6951-4efd-8822-cd27b5891b9e tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "0bb36614-4020-4eb5-81b3-f8e9a5f43541" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.905s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:13:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:13:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-changed-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Refreshing instance network info cache due to event network-changed-dcee886a-49b7-49b4-bae3-2a444a1eb6a3. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] Acquiring lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] Acquired lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Refreshing network info cache for port dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'flavor' on Instance uuid 8439e175-5746-40c7-b0ee-aeb1a636ace6 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:13:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Ignoring supplied device name: /dev/vdb
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:13:52 user nova-compute[75734]: INFO nova.compute.manager [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Attaching volume 04ac1411-7299-4324-9f50-41c8bb9c909f to /dev/vdb
Nov 22 16:13:52 user nova-compute[75734]: DEBUG os_brick.utils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b046d8-581a-493a-9a15-74d308d30d86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[353453cf-0253-42a1-a70c-1b2c22d7287b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce2125b-a00b-476c-aef7-c62a56dead35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f96507-087a-42b1-ae02-f442a64adbb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:13:53 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:13:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95944b2-7dbb-4793-a1ea-12f1781118fc]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG os_brick.utils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Updating existing volume attachment record: d7edd14e-5d87-4aec-803e-fb9a491318ff {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Updated VIF entry in instance network info cache for port dcee886a-49b7-49b4-bae3-2a444a1eb6a3. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Updating instance_info_cache with network_info: [{"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:13:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-56ef051a-2f89-49bf-a59b-aeb9784d4468 req-bc5af3a9-91e4-47ef-a396-975d3ba31530 service nova] Releasing lock "refresh_cache-8439e175-5746-40c7-b0ee-aeb1a636ace6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:13:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:13:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:13:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKfunCBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:13:59 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:13:59 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:13:59 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[34afc98b-4d51-4fbe-b704-1440c62555e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:13:59 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f21255c-b951-4234-b32e-6217660786cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f] added
Nov 22 16:13:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2342b23-5223-4d1e-85f2-e791fa49b2d4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c532af-9f46-4889-88ab-749bbaa3322a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKfunCBc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKfunCBc" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d52539c-e3a8-4678-ad41-f4a9f237368d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKfunCBc'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8038bc7-2ada-4548-a784-bcb0899f27c4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f468c5b1-62b3-46d8-8d40-283a1911b22c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:13:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:13:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001bcb1-6b2b-4a90-8996-18eb34e3d454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260]
Nov 22 16:13:59 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260] successful.
Nov 22 16:13:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccf7b65-4866-4812-b34d-62ad2fb79bd8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4933acca-f8d5-4ad6-9d6c-882826a1566e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:13:59 user nova-compute[75734]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f (non-flash)
Nov 22 16:13:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:13:59 user nova-compute[75734]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f (non-flash)
Nov 22 16:13:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[88339259-dfa8-4b8e-8c29-874db9a9d58c]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKfunCBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:13:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23261646365386366', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261646365386366', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'flavor' on Instance uuid 8439e175-5746-40c7-b0ee-aeb1a636ace6 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:14:00 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:14:00 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:14:00 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:14:00 user nova-compute[75734]:   <serial>04ac1411-7299-4324-9f50-41c8bb9c909f</serial>
Nov 22 16:14:00 user nova-compute[75734]: </disk>
Nov 22 16:14:00 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No VIF found with MAC fa:16:3e:62:78:0e, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:14:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ed510462-33ac-46a4-bc51-fc7b00f78434 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.011s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [{"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-6252f7b5-0458-42d4-8747-dfe425918dec" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:14:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:14:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:14:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.110008239746094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 6252f7b5-0458-42d4-8747-dfe425918dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.781s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:14:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:14:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "0d53cd4b-c15a-4680-ae68-b115ca593a12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:14:19 user nova-compute[75734]: INFO nova.compute.claims [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Claim successful on node user
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:14:19 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:14:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:14:20 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Creating image(s)
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "/opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "/opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG nova.policy [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da55f9e4b84947fe93de3585d6588929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf8c0e6c5c4b449e2c3a81a1dfcf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.228s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk 1073741824" returned: 0 in 0.061s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.203s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:14:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Cannot resize image /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Ensure instance console log exists: /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG nova.network.neutron [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Successfully created port: 78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:21 user nova-compute[75734]: INFO nova.compute.manager [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Detaching volume 04ac1411-7299-4324-9f50-41c8bb9c909f
Nov 22 16:14:21 user nova-compute[75734]: INFO nova.virt.block_device [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Attempting to driver detach volume 04ac1411-7299-4324-9f50-41c8bb9c909f from mountpoint /dev/vdb
Nov 22 16:14:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Attempting to detach device vdb from instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:14:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:14:21 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:14:21 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:14:21 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:14:21 user nova-compute[75734]:   <serial>04ac1411-7299-4324-9f50-41c8bb9c909f</serial>
Nov 22 16:14:21 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:14:21 user nova-compute[75734]: </disk>
Nov 22 16:14:21 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:14:22 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully detached device vdb from instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 from the persistent domain config.
Nov 22 16:14:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:14:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:14:22 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:14:22 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:14:22 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:14:22 user nova-compute[75734]:   <serial>04ac1411-7299-4324-9f50-41c8bb9c909f</serial>
Nov 22 16:14:22 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:14:22 user nova-compute[75734]: </disk>
Nov 22 16:14:22 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:14:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG nova.network.neutron [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Successfully updated port: 78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "refresh_cache-0d53cd4b-c15a-4680-ae68-b115ca593a12" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquired lock "refresh_cache-0d53cd4b-c15a-4680-ae68-b115ca593a12" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG nova.network.neutron [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG nova.network.neutron [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received event network-changed-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Refreshing instance network info cache due to event network-changed-78659e1c-3e59-4349-b687-6b7799194df5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:14:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] Acquiring lock "refresh_cache-0d53cd4b-c15a-4680-ae68-b115ca593a12" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.neutron [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Updating instance_info_cache with network_info: [{"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Releasing lock "refresh_cache-0d53cd4b-c15a-4680-ae68-b115ca593a12" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Instance network_info: |[{"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] Acquired lock "refresh_cache-0d53cd4b-c15a-4680-ae68-b115ca593a12" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Refreshing network info cache for port 78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Start _get_guest_xml network_info=[{"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:14:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:14:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1780019339',display_name='tempest-VolumesNegativeTest-instance-1780019339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1780019339',id=35,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9bf8c0e6c5c4b449e2c3a81a1dfcf43',ramdisk_id='',reservation_id='r-dtodx5pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1554866187',owner_user_name='tempest-VolumesNegativeTest-1554866187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:14:20Z,user_data=None,user_id='da55f9e4b84947fe93de3585d6588929',uuid=0d53cd4b-c15a-4680-ae68-b115ca593a12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Converting VIF {"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:76,bridge_name='br-int',has_traffic_filtering=True,id=78659e1c-3e59-4349-b687-6b7799194df5,network=Network(b6f1d237-38c5-48f2-b5eb-2decdaf76c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78659e1c-3e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.objects.instance [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d53cd4b-c15a-4680-ae68-b115ca593a12 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:14:24 user nova-compute[75734]:   <uuid>0d53cd4b-c15a-4680-ae68-b115ca593a12</uuid>
Nov 22 16:14:24 user nova-compute[75734]:   <name>instance-00000023</name>
Nov 22 16:14:24 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:14:24 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:14:24 user nova-compute[75734]:   <metadata>
Nov 22 16:14:24 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:14:24 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:14:24 user nova-compute[75734]:       <nova:name>tempest-VolumesNegativeTest-instance-1780019339</nova:name>
Nov 22 16:14:24 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:14:24</nova:creationTime>
Nov 22 16:14:24 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:14:24 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:14:24 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:14:24 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:14:24 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:14:24 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:14:24 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:14:24 user nova-compute[75734]:       <nova:owner>
Nov 22 16:14:24 user nova-compute[75734]:         <nova:user uuid="da55f9e4b84947fe93de3585d6588929">tempest-VolumesNegativeTest-1554866187-project-member</nova:user>
Nov 22 16:14:24 user nova-compute[75734]:         <nova:project uuid="a9bf8c0e6c5c4b449e2c3a81a1dfcf43">tempest-VolumesNegativeTest-1554866187</nova:project>
Nov 22 16:14:24 user nova-compute[75734]:       </nova:owner>
Nov 22 16:14:24 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:14:24 user nova-compute[75734]:       <nova:ports>
Nov 22 16:14:24 user nova-compute[75734]:         <nova:port uuid="78659e1c-3e59-4349-b687-6b7799194df5">
Nov 22 16:14:24 user nova-compute[75734]:           <nova:ip type="fixed" address="192.168.233.59" ipVersion="4"/>
Nov 22 16:14:24 user nova-compute[75734]:         </nova:port>
Nov 22 16:14:24 user nova-compute[75734]:       </nova:ports>
Nov 22 16:14:24 user nova-compute[75734]:     </nova:instance>
Nov 22 16:14:24 user nova-compute[75734]:   </metadata>
Nov 22 16:14:24 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:14:24 user nova-compute[75734]:     <system>
Nov 22 16:14:24 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:14:24 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:14:24 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:14:24 user nova-compute[75734]:       <entry name="serial">0d53cd4b-c15a-4680-ae68-b115ca593a12</entry>
Nov 22 16:14:24 user nova-compute[75734]:       <entry name="uuid">0d53cd4b-c15a-4680-ae68-b115ca593a12</entry>
Nov 22 16:14:24 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:14:24 user nova-compute[75734]:     </system>
Nov 22 16:14:24 user nova-compute[75734]:   </sysinfo>
Nov 22 16:14:24 user nova-compute[75734]:   <os>
Nov 22 16:14:24 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:14:24 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:14:24 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:14:24 user nova-compute[75734]:   </os>
Nov 22 16:14:24 user nova-compute[75734]:   <features>
Nov 22 16:14:24 user nova-compute[75734]:     <acpi/>
Nov 22 16:14:24 user nova-compute[75734]:     <apic/>
Nov 22 16:14:24 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:14:24 user nova-compute[75734]:   </features>
Nov 22 16:14:24 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:14:24 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:14:24 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:14:24 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:14:24 user nova-compute[75734]:   </clock>
Nov 22 16:14:24 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:14:24 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:14:24 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:14:24 user nova-compute[75734]:   </cpu>
Nov 22 16:14:24 user nova-compute[75734]:   <devices>
Nov 22 16:14:24 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:14:24 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:14:24 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk"/>
Nov 22 16:14:24 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:14:24 user nova-compute[75734]:     </disk>
Nov 22 16:14:24 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:14:24 user nova-compute[75734]:       <mac address="fa:16:3e:dc:92:76"/>
Nov 22 16:14:24 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:14:24 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:14:24 user nova-compute[75734]:       <target dev="tap78659e1c-3e"/>
Nov 22 16:14:24 user nova-compute[75734]:     </interface>
Nov 22 16:14:24 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:14:24 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/console.log" append="off"/>
Nov 22 16:14:24 user nova-compute[75734]:     </serial>
Nov 22 16:14:24 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:14:24 user nova-compute[75734]:     <video>
Nov 22 16:14:24 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:14:24 user nova-compute[75734]:     </video>
Nov 22 16:14:24 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:14:24 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:14:24 user nova-compute[75734]:     </rng>
Nov 22 16:14:24 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:14:24 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:14:24 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:14:24 user nova-compute[75734]:     </memballoon>
Nov 22 16:14:24 user nova-compute[75734]:   </devices>
Nov 22 16:14:24 user nova-compute[75734]: </domain>
Nov 22 16:14:24 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1780019339',display_name='tempest-VolumesNegativeTest-instance-1780019339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1780019339',id=35,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9bf8c0e6c5c4b449e2c3a81a1dfcf43',ramdisk_id='',reservation_id='r-dtodx5pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1554866187',owner_user_name='tempest-VolumesNegativeTest-1554866187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:14:20Z,user_data=None,user_id='da55f9e4b84947fe93de3585d6588929',uuid=0d53cd4b-c15a-4680-ae68-b115ca593a12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Converting VIF {"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:76,bridge_name='br-int',has_traffic_filtering=True,id=78659e1c-3e59-4349-b687-6b7799194df5,network=Network(b6f1d237-38c5-48f2-b5eb-2decdaf76c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78659e1c-3e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG os_vif [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:76,bridge_name='br-int',has_traffic_filtering=True,id=78659e1c-3e59-4349-b687-6b7799194df5,network=Network(b6f1d237-38c5-48f2-b5eb-2decdaf76c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78659e1c-3e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68e38402-7d04-564d-ad62-2fb365d642c3', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78659e1c-3e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78659e1c-3e, col_values=(('qos', UUID('3cb0828c-9fd0-4b16-a2c1-646a5a1a76b2')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78659e1c-3e, col_values=(('external_ids', {'iface-id': '78659e1c-3e59-4349-b687-6b7799194df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:92:76', 'vm-uuid': '0d53cd4b-c15a-4680-ae68-b115ca593a12'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:24 user nova-compute[75734]: INFO os_vif [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:76,bridge_name='br-int',has_traffic_filtering=True,id=78659e1c-3e59-4349-b687-6b7799194df5,network=Network(b6f1d237-38c5-48f2-b5eb-2decdaf76c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78659e1c-3e')
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Updated VIF entry in instance network info cache for port 78659e1c-3e59-4349-b687-6b7799194df5. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Updating instance_info_cache with network_info: [{"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:14:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-57c98702-a74e-42c6-8a4d-9cee89e98ec1 req-b6ef5f40-c211-4b7a-a44b-23c60e828f88 service nova] Releasing lock "refresh_cache-0d53cd4b-c15a-4680-ae68-b115ca593a12" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:14:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:14:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] No VIF found with MAC fa:16:3e:dc:92:76, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:14:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:14:27 user nova-compute[75734]: INFO nova.compute.claims [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Claim successful on node user
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:14:27 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:14:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG nova.policy [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c444f0bec7641458313d99ebcac79e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0470a32bf194b2ca5de3bd71af4409d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-b75de820-0201-4f50-89da-3b18488eca8e req-bd90f234-d730-4ec3-976c-b1ca6b1ad6b1 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received event network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b75de820-0201-4f50-89da-3b18488eca8e req-bd90f234-d730-4ec3-976c-b1ca6b1ad6b1 service nova] Acquiring lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b75de820-0201-4f50-89da-3b18488eca8e req-bd90f234-d730-4ec3-976c-b1ca6b1ad6b1 service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b75de820-0201-4f50-89da-3b18488eca8e req-bd90f234-d730-4ec3-976c-b1ca6b1ad6b1 service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-b75de820-0201-4f50-89da-3b18488eca8e req-bd90f234-d730-4ec3-976c-b1ca6b1ad6b1 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] No waiting events found dispatching network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:14:28 user nova-compute[75734]: WARNING nova.compute.manager [req-b75de820-0201-4f50-89da-3b18488eca8e req-bd90f234-d730-4ec3-976c-b1ca6b1ad6b1 service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received unexpected event network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 for instance with vm_state building and task_state spawning.
Nov 22 16:14:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:14:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Creating image(s)
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.226s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.233s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk 1073741824" returned: 0 in 0.160s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.399s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:14:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Successfully created port: 2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Cannot resize image /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Ensure instance console log exists: /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Successfully updated port: 2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquired lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:14:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received event network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] Acquiring lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] No waiting events found dispatching network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:14:30 user nova-compute[75734]: WARNING nova.compute.manager [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received unexpected event network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 for instance with vm_state building and task_state spawning.
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.compute.manager [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing instance network info cache due to event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] Acquiring lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Releasing lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance network_info: |[{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] Acquired lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.neutron [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Start _get_guest_xml network_info=[{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:14:30 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:14:30 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-214828451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-214828451',id=36,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlRIlbTs8pi6TX58kK7DfgmNp7Sv050i5Di2/sbU7f9f4Ov7HydeCH8+m0BgG4BmayXiOsTi5gZ4YosZBZLsqf/JYx7DMRm2Vxhu+hPSa5hNODo6a5DsBfqcNV3X+QEjA==',key_name='tempest-keypair-1751822900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-x90dzzuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=cf6e3423-f1dc-44ca-92df-2260155485e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'pci_devices' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:14:30 user nova-compute[75734]:   <uuid>cf6e3423-f1dc-44ca-92df-2260155485e5</uuid>
Nov 22 16:14:30 user nova-compute[75734]:   <name>instance-00000024</name>
Nov 22 16:14:30 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:14:30 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:14:30 user nova-compute[75734]:   <metadata>
Nov 22 16:14:30 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:14:30 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:14:30 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-214828451</nova:name>
Nov 22 16:14:30 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:14:30</nova:creationTime>
Nov 22 16:14:30 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:14:30 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:14:30 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:14:30 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:14:30 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:14:30 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:14:30 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:14:30 user nova-compute[75734]:       <nova:owner>
Nov 22 16:14:30 user nova-compute[75734]:         <nova:user uuid="4c444f0bec7641458313d99ebcac79e1">tempest-AttachVolumeShelveTestJSON-1751141796-project-member</nova:user>
Nov 22 16:14:30 user nova-compute[75734]:         <nova:project uuid="c0470a32bf194b2ca5de3bd71af4409d">tempest-AttachVolumeShelveTestJSON-1751141796</nova:project>
Nov 22 16:14:30 user nova-compute[75734]:       </nova:owner>
Nov 22 16:14:30 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:14:30 user nova-compute[75734]:       <nova:ports>
Nov 22 16:14:30 user nova-compute[75734]:         <nova:port uuid="2a2737fe-70bc-41f2-b05e-4b74440bc3b1">
Nov 22 16:14:30 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 16:14:30 user nova-compute[75734]:         </nova:port>
Nov 22 16:14:30 user nova-compute[75734]:       </nova:ports>
Nov 22 16:14:30 user nova-compute[75734]:     </nova:instance>
Nov 22 16:14:30 user nova-compute[75734]:   </metadata>
Nov 22 16:14:30 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:14:30 user nova-compute[75734]:     <system>
Nov 22 16:14:30 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:14:30 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:14:30 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:14:30 user nova-compute[75734]:       <entry name="serial">cf6e3423-f1dc-44ca-92df-2260155485e5</entry>
Nov 22 16:14:30 user nova-compute[75734]:       <entry name="uuid">cf6e3423-f1dc-44ca-92df-2260155485e5</entry>
Nov 22 16:14:30 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:14:30 user nova-compute[75734]:     </system>
Nov 22 16:14:30 user nova-compute[75734]:   </sysinfo>
Nov 22 16:14:30 user nova-compute[75734]:   <os>
Nov 22 16:14:30 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:14:30 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:14:30 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:14:30 user nova-compute[75734]:   </os>
Nov 22 16:14:30 user nova-compute[75734]:   <features>
Nov 22 16:14:30 user nova-compute[75734]:     <acpi/>
Nov 22 16:14:30 user nova-compute[75734]:     <apic/>
Nov 22 16:14:30 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:14:30 user nova-compute[75734]:   </features>
Nov 22 16:14:30 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:14:30 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:14:30 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:14:30 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:14:30 user nova-compute[75734]:   </clock>
Nov 22 16:14:30 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:14:30 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:14:30 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:14:30 user nova-compute[75734]:   </cpu>
Nov 22 16:14:30 user nova-compute[75734]:   <devices>
Nov 22 16:14:30 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:14:30 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:14:30 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk"/>
Nov 22 16:14:30 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:14:30 user nova-compute[75734]:     </disk>
Nov 22 16:14:30 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:14:30 user nova-compute[75734]:       <mac address="fa:16:3e:24:a6:6f"/>
Nov 22 16:14:30 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:14:30 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:14:30 user nova-compute[75734]:       <target dev="tap2a2737fe-70"/>
Nov 22 16:14:30 user nova-compute[75734]:     </interface>
Nov 22 16:14:30 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:14:30 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/console.log" append="off"/>
Nov 22 16:14:30 user nova-compute[75734]:     </serial>
Nov 22 16:14:30 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:14:30 user nova-compute[75734]:     <video>
Nov 22 16:14:30 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:14:30 user nova-compute[75734]:     </video>
Nov 22 16:14:30 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:14:30 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:14:30 user nova-compute[75734]:     </rng>
Nov 22 16:14:30 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:14:30 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:14:30 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:14:30 user nova-compute[75734]:     </memballoon>
Nov 22 16:14:30 user nova-compute[75734]:   </devices>
Nov 22 16:14:30 user nova-compute[75734]: </domain>
Nov 22 16:14:30 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-214828451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-214828451',id=36,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlRIlbTs8pi6TX58kK7DfgmNp7Sv050i5Di2/sbU7f9f4Ov7HydeCH8+m0BgG4BmayXiOsTi5gZ4YosZBZLsqf/JYx7DMRm2Vxhu+hPSa5hNODo6a5DsBfqcNV3X+QEjA==',key_name='tempest-keypair-1751822900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-x90dzzuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=cf6e3423-f1dc-44ca-92df-2260155485e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG os_vif [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:14:30 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Instance spawned successfully.
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '604145b5-5f91-5481-ac66-ed7c35333978', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a2737fe-70, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a2737fe-70, col_values=(('qos', UUID('19f0413a-b436-40a8-b939-fd5b557980c4')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a2737fe-70, col_values=(('external_ids', {'iface-id': '2a2737fe-70bc-41f2-b05e-4b74440bc3b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:a6:6f', 'vm-uuid': 'cf6e3423-f1dc-44ca-92df-2260155485e5'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:30 user nova-compute[75734]: INFO os_vif [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70')
Nov 22 16:14:30 user nova-compute[75734]: INFO nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Took 10.57 seconds to spawn the instance on the hypervisor.
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No VIF found with MAC fa:16:3e:24:a6:6f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:14:30 user nova-compute[75734]: INFO nova.compute.manager [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Took 11.41 seconds to build instance.
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-98bfe282-068b-4d6e-8560-13eeb105fc36 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.528s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.neutron [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updated VIF entry in instance network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG nova.network.neutron [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:14:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-813c9ced-0676-4ad1-b870-db3aaca8bddc req-b2f57b01-993c-46e6-93da-ad62ec92c99c service nova] Releasing lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:14:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-0db55c37-4695-469d-bdba-406dc59cc940 req-1c338e6a-143d-4cbd-96fa-0c4bf05db175 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0db55c37-4695-469d-bdba-406dc59cc940 req-1c338e6a-143d-4cbd-96fa-0c4bf05db175 service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0db55c37-4695-469d-bdba-406dc59cc940 req-1c338e6a-143d-4cbd-96fa-0c4bf05db175 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0db55c37-4695-469d-bdba-406dc59cc940 req-1c338e6a-143d-4cbd-96fa-0c4bf05db175 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-0db55c37-4695-469d-bdba-406dc59cc940 req-1c338e6a-143d-4cbd-96fa-0c4bf05db175 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:14:33 user nova-compute[75734]: WARNING nova.compute.manager [req-0db55c37-4695-469d-bdba-406dc59cc940 req-1c338e6a-143d-4cbd-96fa-0c4bf05db175 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received unexpected event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with vm_state building and task_state spawning.
Nov 22 16:14:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-4d3ae75c-c27b-4bc1-a39f-f6e69029c09a req-4e0ac053-d5f7-4752-a50c-23e7fda63653 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4d3ae75c-c27b-4bc1-a39f-f6e69029c09a req-4e0ac053-d5f7-4752-a50c-23e7fda63653 service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4d3ae75c-c27b-4bc1-a39f-f6e69029c09a req-4e0ac053-d5f7-4752-a50c-23e7fda63653 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4d3ae75c-c27b-4bc1-a39f-f6e69029c09a req-4e0ac053-d5f7-4752-a50c-23e7fda63653 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-4d3ae75c-c27b-4bc1-a39f-f6e69029c09a req-4e0ac053-d5f7-4752-a50c-23e7fda63653 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:14:35 user nova-compute[75734]: WARNING nova.compute.manager [req-4d3ae75c-c27b-4bc1-a39f-f6e69029c09a req-4e0ac053-d5f7-4752-a50c-23e7fda63653 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received unexpected event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with vm_state building and task_state spawning.
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:14:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance spawned successfully.
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:14:36 user nova-compute[75734]: INFO nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Took 8.42 seconds to spawn the instance on the hypervisor.
Nov 22 16:14:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:14:36 user nova-compute[75734]: INFO nova.compute.manager [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Took 9.51 seconds to build instance.
Nov 22 16:14:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0a500f2d-cf40-4e0e-bfed-b33f7a410b9c tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.642s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:43 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 is timed out.
Nov 22 16:14:43 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully detached device vdb from instance 8439e175-5746-40c7-b0ee-aeb1a636ace6 from the live domain config.
Nov 22 16:14:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKfunCBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:14:43 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf4761f-daa4-4c8a-85b4-2c56b3f9afef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:14:43 user nova-compute[75734]: No targets found.
Nov 22 16:14:43 user nova-compute[75734]: iSNS:
Nov 22 16:14:43 user nova-compute[75734]: No targets found.
Nov 22 16:14:43 user nova-compute[75734]: STATIC:
Nov 22 16:14:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f
Nov 22 16:14:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:14:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:14:43 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:14:43 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:14:43 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:14:43 user nova-compute[75734]: FIRMWARE:
Nov 22 16:14:43 user nova-compute[75734]: No targets found.
Nov 22 16:14:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:14:43 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:14:43 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bae37e-749a-4f0e-b81e-4917c0539912]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a72fccc-5b58-4701-876b-b5ea4602f565]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:14:43 user nova-compute[75734]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f (non-flash)
Nov 22 16:14:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:14:43 user nova-compute[75734]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f (non-flash)
Nov 22 16:14:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac732cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b734eabd-de27-4138-b2ea-6c3436dce4c5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29a6a4-7f4c-400b-ad1d-8b8b91d3d79d]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6479ea24-5288-4d1b-bac7-58bf1a6ea5b5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e31c0f1-a0dd-4319-953a-047e04a87ed3]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a9c24-282c-4edc-810d-1a495b65b212]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e251f1e4-379b-4bd4-aac1-e41b3d7e19dc]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260]
Nov 22 16:14:43 user nova-compute[75734]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f, portal: 172.16.0.220,3260] successful.
Nov 22 16:14:43 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[263540db-bb89-4078-8cb1-a71ab505cf04]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== disconnect_volume: return (371ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:14:43 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:14:44 user nova-compute[75734]: DEBUG nova.objects.instance [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'flavor' on Instance uuid 8439e175-5746-40c7-b0ee-aeb1a636ace6 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:14:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-fdfc4708-f8b6-4f7c-ac4d-24fa3b859d49 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.469s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.776s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:44 user nova-compute[75734]: INFO nova.compute.manager [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Terminating instance
Nov 22 16:14:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-707623f6-02af-4671-ae20-b9a46be78d77 req-94dda4ad-f826-476f-9bc3-eebe4be1b7fb service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-vif-unplugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-707623f6-02af-4671-ae20-b9a46be78d77 req-94dda4ad-f826-476f-9bc3-eebe4be1b7fb service nova] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-707623f6-02af-4671-ae20-b9a46be78d77 req-94dda4ad-f826-476f-9bc3-eebe4be1b7fb service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-707623f6-02af-4671-ae20-b9a46be78d77 req-94dda4ad-f826-476f-9bc3-eebe4be1b7fb service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-707623f6-02af-4671-ae20-b9a46be78d77 req-94dda4ad-f826-476f-9bc3-eebe4be1b7fb service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] No waiting events found dispatching network-vif-unplugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-707623f6-02af-4671-ae20-b9a46be78d77 req-94dda4ad-f826-476f-9bc3-eebe4be1b7fb service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-vif-unplugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:14:45 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Instance destroyed successfully.
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.objects.instance [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'resources' on Instance uuid 8439e175-5746-40c7-b0ee-aeb1a636ace6 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427174366',display_name='tempest-VolumesSnapshotTestJSON-instance-427174366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427174366',id=34,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECmXcVONce/eNh/mqesmyJV+qI22Ld2K6BOmeyXRdqdLYWJRFXAWA/0/Nxq8RZckBpVYCjbI2Isai/kcB6W/jhBt6bcGB5C1lXgxqGkfHWLhYlmnYXGk6OKGnCmbYdyOQ==',key_name='tempest-keypair-1144764740',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:12:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='866f8883870d4feebe60b3fb3031f8d3',ramdisk_id='',reservation_id='r-0e2fjx0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1189754321',owner_user_name='tempest-VolumesSnapshotTestJSON-1189754321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='034f9dedcf294f7093e65368c74abb47',uuid=8439e175-5746-40c7-b0ee-aeb1a636ace6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converting VIF {"id": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "address": "fa:16:3e:62:78:0e", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcee886a-49", "ovs_interfaceid": "dcee886a-49b7-49b4-bae3-2a444a1eb6a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:0e,bridge_name='br-int',has_traffic_filtering=True,id=dcee886a-49b7-49b4-bae3-2a444a1eb6a3,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcee886a-49') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_vif [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:0e,bridge_name='br-int',has_traffic_filtering=True,id=dcee886a-49b7-49b4-bae3-2a444a1eb6a3,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcee886a-49') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcee886a-49, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d85d0b32-7002-48bd-8fd4-747d3a5a9a1b) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:14:45 user nova-compute[75734]: INFO os_vif [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:0e,bridge_name='br-int',has_traffic_filtering=True,id=dcee886a-49b7-49b4-bae3-2a444a1eb6a3,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcee886a-49')
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKfunCBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:14:45 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[536003e4-dd5c-4206-a92c-88bd5605b976]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:14:45 user nova-compute[75734]: No targets found.
Nov 22 16:14:45 user nova-compute[75734]: iSNS:
Nov 22 16:14:45 user nova-compute[75734]: No targets found.
Nov 22 16:14:45 user nova-compute[75734]: STATIC:
Nov 22 16:14:45 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:14:45 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:14:45 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:14:45 user nova-compute[75734]: FIRMWARE:
Nov 22 16:14:45 user nova-compute[75734]: No targets found.
Nov 22 16:14:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:14:45 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:14:45 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ac1411-7299-4324-9f50-41c8bb9c909f', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65fd3bc-daa6-4f5b-b235-38329ae28224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e163de-0f2a-45fa-aef7-71a080a65371]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:14:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:14:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac6b0940>, {}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Disconnecting from: [] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== disconnect_volume: return (88ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:14:45 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Deleting instance files /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6_del
Nov 22 16:14:45 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Deletion of /opt/stack/data/nova/instances/8439e175-5746-40c7-b0ee-aeb1a636ace6_del complete
Nov 22 16:14:45 user nova-compute[75734]: INFO nova.compute.manager [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 22 16:14:45 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:14:45 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:14:47 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Took 1.16 seconds to deallocate network for instance.
Nov 22 16:14:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-8e7d66a6-5306-41b2-ac24-c84b9e0d602a req-a758c954-6d55-40cd-b5ca-e8a097d94c71 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-vif-deleted-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:47 user nova-compute[75734]: WARNING nova.volume.cinder [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Attachment d7edd14e-5d87-4aec-803e-fb9a491318ff does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d7edd14e-5d87-4aec-803e-fb9a491318ff. (HTTP 404) (Request-ID: req-9e9bed6a-25b9-4d7f-b152-2059474d60fa)
Nov 22 16:14:47 user nova-compute[75734]: INFO nova.compute.manager [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Took 0.08 seconds to detach 1 volumes for instance.
Nov 22 16:14:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-d79530ff-5cc6-4a80-a0d6-7f54328a18e7 req-f0b04af8-9a23-4d80-9c84-2d83ea875812 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received event network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d79530ff-5cc6-4a80-a0d6-7f54328a18e7 req-f0b04af8-9a23-4d80-9c84-2d83ea875812 service nova] Acquiring lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d79530ff-5cc6-4a80-a0d6-7f54328a18e7 req-f0b04af8-9a23-4d80-9c84-2d83ea875812 service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d79530ff-5cc6-4a80-a0d6-7f54328a18e7 req-f0b04af8-9a23-4d80-9c84-2d83ea875812 service nova] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-d79530ff-5cc6-4a80-a0d6-7f54328a18e7 req-f0b04af8-9a23-4d80-9c84-2d83ea875812 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] No waiting events found dispatching network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:14:47 user nova-compute[75734]: WARNING nova.compute.manager [req-d79530ff-5cc6-4a80-a0d6-7f54328a18e7 req-f0b04af8-9a23-4d80-9c84-2d83ea875812 service nova] [instance: 8439e175-5746-40c7-b0ee-aeb1a636ace6] Received unexpected event network-vif-plugged-dcee886a-49b7-49b4-bae3-2a444a1eb6a3 for instance with vm_state deleted and task_state None.
Nov 22 16:14:47 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Deleted allocations for instance 8439e175-5746-40c7-b0ee-aeb1a636ace6
Nov 22 16:14:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-16e6ed25-b911-4d17-b9dd-50a303c9f558 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "8439e175-5746-40c7-b0ee-aeb1a636ace6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:14:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:14:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:14:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:14:58 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:15:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:15:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=25.068538665771484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 6252f7b5-0458-42d4-8747-dfe425918dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0d53cd4b-c15a-4680-ae68-b115ca593a12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cf6e3423-f1dc-44ca-92df-2260155485e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:15:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:06 user nova-compute[75734]: INFO nova.compute.manager [None req-80a726fc-b2b1-4438-8ee3-51dc9e487830 tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Get console output
Nov 22 16:15:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:06 user nova-compute[75734]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 22 16:15:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:15:31 user nova-compute[75734]: INFO nova.compute.claims [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Claim successful on node user
Nov 22 16:15:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:15:32 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.policy [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '034f9dedcf294f7093e65368c74abb47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866f8883870d4feebe60b3fb3031f8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:15:32 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Creating image(s)
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "/opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "/opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk 1073741824" returned: 0 in 0.065s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Successfully created port: 0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Cannot resize image /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:15:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Ensure instance console log exists: /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Successfully updated port: 0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquired lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-changed-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Refreshing instance network info cache due to event network-changed-0ae1c41c-7eb1-41e3-8289-286d56e8cf42. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] Acquiring lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:15:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updating instance_info_cache with network_info: [{"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Releasing lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Instance network_info: |[{"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] Acquired lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Refreshing network info cache for port 0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Start _get_guest_xml network_info=[{"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:15:34 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:15:34 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1685049613',display_name='tempest-VolumesSnapshotTestJSON-instance-1685049613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1685049613',id=37,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIudemC8uB0e8w7vOdbsHoTbfD8MdxqWLOdSbt2gwp7pyMROwRvusgOmxvPv5ZohF3tcH1//doCCAGeZQxmzCEWMcN+4w4w9SlIEyIuNaksGnE5Np+G7oMgj+RzOqagIQQ==',key_name='tempest-keypair-539409635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='866f8883870d4feebe60b3fb3031f8d3',ramdisk_id='',reservation_id='r-fxc0kcoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1189754321',owner_user_name='tempest-VolumesSnapshotTestJSON-1189754321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='034f9dedcf294f7093e65368c74abb47',uuid=fc7bf3ae-9441-4fc5-acfd-b0db023065d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converting VIF {"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:9b,bridge_name='br-int',has_traffic_filtering=True,id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ae1c41c-7e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'pci_devices' on Instance uuid fc7bf3ae-9441-4fc5-acfd-b0db023065d3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:15:34 user nova-compute[75734]:   <uuid>fc7bf3ae-9441-4fc5-acfd-b0db023065d3</uuid>
Nov 22 16:15:34 user nova-compute[75734]:   <name>instance-00000025</name>
Nov 22 16:15:34 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:15:34 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:15:34 user nova-compute[75734]:   <metadata>
Nov 22 16:15:34 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:15:34 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:15:34 user nova-compute[75734]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1685049613</nova:name>
Nov 22 16:15:34 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:15:34</nova:creationTime>
Nov 22 16:15:34 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:15:34 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:15:34 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:15:34 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:15:34 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:15:34 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:15:34 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:15:34 user nova-compute[75734]:       <nova:owner>
Nov 22 16:15:34 user nova-compute[75734]:         <nova:user uuid="034f9dedcf294f7093e65368c74abb47">tempest-VolumesSnapshotTestJSON-1189754321-project-member</nova:user>
Nov 22 16:15:34 user nova-compute[75734]:         <nova:project uuid="866f8883870d4feebe60b3fb3031f8d3">tempest-VolumesSnapshotTestJSON-1189754321</nova:project>
Nov 22 16:15:34 user nova-compute[75734]:       </nova:owner>
Nov 22 16:15:34 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:15:34 user nova-compute[75734]:       <nova:ports>
Nov 22 16:15:34 user nova-compute[75734]:         <nova:port uuid="0ae1c41c-7eb1-41e3-8289-286d56e8cf42">
Nov 22 16:15:34 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:15:34 user nova-compute[75734]:         </nova:port>
Nov 22 16:15:34 user nova-compute[75734]:       </nova:ports>
Nov 22 16:15:34 user nova-compute[75734]:     </nova:instance>
Nov 22 16:15:34 user nova-compute[75734]:   </metadata>
Nov 22 16:15:34 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:15:34 user nova-compute[75734]:     <system>
Nov 22 16:15:34 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:15:34 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:15:34 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:15:34 user nova-compute[75734]:       <entry name="serial">fc7bf3ae-9441-4fc5-acfd-b0db023065d3</entry>
Nov 22 16:15:34 user nova-compute[75734]:       <entry name="uuid">fc7bf3ae-9441-4fc5-acfd-b0db023065d3</entry>
Nov 22 16:15:34 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:15:34 user nova-compute[75734]:     </system>
Nov 22 16:15:34 user nova-compute[75734]:   </sysinfo>
Nov 22 16:15:34 user nova-compute[75734]:   <os>
Nov 22 16:15:34 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:15:34 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:15:34 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:15:34 user nova-compute[75734]:   </os>
Nov 22 16:15:34 user nova-compute[75734]:   <features>
Nov 22 16:15:34 user nova-compute[75734]:     <acpi/>
Nov 22 16:15:34 user nova-compute[75734]:     <apic/>
Nov 22 16:15:34 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:15:34 user nova-compute[75734]:   </features>
Nov 22 16:15:34 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:15:34 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:15:34 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:15:34 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:15:34 user nova-compute[75734]:   </clock>
Nov 22 16:15:34 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:15:34 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:15:34 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:15:34 user nova-compute[75734]:   </cpu>
Nov 22 16:15:34 user nova-compute[75734]:   <devices>
Nov 22 16:15:34 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:15:34 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:15:34 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk"/>
Nov 22 16:15:34 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:15:34 user nova-compute[75734]:     </disk>
Nov 22 16:15:34 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:15:34 user nova-compute[75734]:       <mac address="fa:16:3e:a9:81:9b"/>
Nov 22 16:15:34 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:15:34 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:15:34 user nova-compute[75734]:       <target dev="tap0ae1c41c-7e"/>
Nov 22 16:15:34 user nova-compute[75734]:     </interface>
Nov 22 16:15:34 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:15:34 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/console.log" append="off"/>
Nov 22 16:15:34 user nova-compute[75734]:     </serial>
Nov 22 16:15:34 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:15:34 user nova-compute[75734]:     <video>
Nov 22 16:15:34 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:15:34 user nova-compute[75734]:     </video>
Nov 22 16:15:34 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:15:34 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:15:34 user nova-compute[75734]:     </rng>
Nov 22 16:15:34 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:15:34 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:15:34 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:15:34 user nova-compute[75734]:     </memballoon>
Nov 22 16:15:34 user nova-compute[75734]:   </devices>
Nov 22 16:15:34 user nova-compute[75734]: </domain>
Nov 22 16:15:34 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1685049613',display_name='tempest-VolumesSnapshotTestJSON-instance-1685049613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1685049613',id=37,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIudemC8uB0e8w7vOdbsHoTbfD8MdxqWLOdSbt2gwp7pyMROwRvusgOmxvPv5ZohF3tcH1//doCCAGeZQxmzCEWMcN+4w4w9SlIEyIuNaksGnE5Np+G7oMgj+RzOqagIQQ==',key_name='tempest-keypair-539409635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='866f8883870d4feebe60b3fb3031f8d3',ramdisk_id='',reservation_id='r-fxc0kcoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1189754321',owner_user_name='tempest-VolumesSnapshotTestJSON-1189754321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='034f9dedcf294f7093e65368c74abb47',uuid=fc7bf3ae-9441-4fc5-acfd-b0db023065d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converting VIF {"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:9b,bridge_name='br-int',has_traffic_filtering=True,id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ae1c41c-7e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG os_vif [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:9b,bridge_name='br-int',has_traffic_filtering=True,id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ae1c41c-7e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02f8487e-4833-5deb-a9e7-ba994dac1ecf', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ae1c41c-7e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ae1c41c-7e, col_values=(('qos', UUID('615a94b4-1d15-4020-a4a5-330c596ad6cc')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ae1c41c-7e, col_values=(('external_ids', {'iface-id': '0ae1c41c-7eb1-41e3-8289-286d56e8cf42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:81:9b', 'vm-uuid': 'fc7bf3ae-9441-4fc5-acfd-b0db023065d3'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:34 user nova-compute[75734]: INFO os_vif [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:9b,bridge_name='br-int',has_traffic_filtering=True,id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ae1c41c-7e')
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No VIF found with MAC fa:16:3e:a9:81:9b, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updated VIF entry in instance network info cache for port 0ae1c41c-7eb1-41e3-8289-286d56e8cf42. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG nova.network.neutron [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updating instance_info_cache with network_info: [{"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:15:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-74eb2916-f2bc-40ca-885b-542642c9f317 req-8397302f-9b34-42db-a06c-ca6e5b853244 service nova] Releasing lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:15:35 user nova-compute[75734]: INFO nova.compute.claims [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Claim successful on node user
Nov 22 16:15:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:15:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:15:35 user nova-compute[75734]: DEBUG nova.policy [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85146896f44c438c8a76a24b1c1b2d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80a3ed83d34275b47766de30c4fe22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:15:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Creating image(s)
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "/opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "/opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "/opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk 1073741824" returned: 0 in 0.047s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Successfully created port: 55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Cannot resize image /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Ensure instance console log exists: /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Successfully updated port: 55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquired lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-changed-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Refreshing instance network info cache due to event network-changed-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] Acquiring lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updating instance_info_cache with network_info: [{"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Releasing lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Instance network_info: |[{"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] Acquired lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Refreshing network info cache for port 55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Start _get_guest_xml network_info=[{"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:15:37 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:15:37 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2058993008',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2058993008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2058993',id=38,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/xjWb5AjnKW18yUVkGARyQfJFT742Q/UYWRZf+VeB7KhZxqdzmYIcooHr7Z7zt3CYX5+HsyGCth0VnJYhjhidtLwy8kY56ecM1mue+KYmUL9OVhVoKkGLeUih07ftfwQ==',key_name='tempest-keypair-1361133888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de80a3ed83d34275b47766de30c4fe22',ramdisk_id='',reservation_id='r-6mk5g1wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1102009632',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85146896f44c438c8a76a24b1c1b2d20',uuid=01cdc407-771b-4793-bbf2-5fce1714da8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Converting VIF {"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5,network=Network(fd72e639-faae-4972-9ab4-ee8abdcf0333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a5ed43-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lazy-loading 'pci_devices' on Instance uuid 01cdc407-771b-4793-bbf2-5fce1714da8d {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:15:37 user nova-compute[75734]:   <uuid>01cdc407-771b-4793-bbf2-5fce1714da8d</uuid>
Nov 22 16:15:37 user nova-compute[75734]:   <name>instance-00000026</name>
Nov 22 16:15:37 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:15:37 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:15:37 user nova-compute[75734]:   <metadata>
Nov 22 16:15:37 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:15:37 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:15:37 user nova-compute[75734]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2058993008</nova:name>
Nov 22 16:15:37 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:15:37</nova:creationTime>
Nov 22 16:15:37 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:15:37 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:15:37 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:15:37 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:15:37 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:15:37 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:15:37 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:15:37 user nova-compute[75734]:       <nova:owner>
Nov 22 16:15:37 user nova-compute[75734]:         <nova:user uuid="85146896f44c438c8a76a24b1c1b2d20">tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member</nova:user>
Nov 22 16:15:37 user nova-compute[75734]:         <nova:project uuid="de80a3ed83d34275b47766de30c4fe22">tempest-TestServerVolumeAttachScenarioOldVersion-1102009632</nova:project>
Nov 22 16:15:37 user nova-compute[75734]:       </nova:owner>
Nov 22 16:15:37 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:15:37 user nova-compute[75734]:       <nova:ports>
Nov 22 16:15:37 user nova-compute[75734]:         <nova:port uuid="55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5">
Nov 22 16:15:37 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 16:15:37 user nova-compute[75734]:         </nova:port>
Nov 22 16:15:37 user nova-compute[75734]:       </nova:ports>
Nov 22 16:15:37 user nova-compute[75734]:     </nova:instance>
Nov 22 16:15:37 user nova-compute[75734]:   </metadata>
Nov 22 16:15:37 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:15:37 user nova-compute[75734]:     <system>
Nov 22 16:15:37 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:15:37 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:15:37 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:15:37 user nova-compute[75734]:       <entry name="serial">01cdc407-771b-4793-bbf2-5fce1714da8d</entry>
Nov 22 16:15:37 user nova-compute[75734]:       <entry name="uuid">01cdc407-771b-4793-bbf2-5fce1714da8d</entry>
Nov 22 16:15:37 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:15:37 user nova-compute[75734]:     </system>
Nov 22 16:15:37 user nova-compute[75734]:   </sysinfo>
Nov 22 16:15:37 user nova-compute[75734]:   <os>
Nov 22 16:15:37 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:15:37 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:15:37 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:15:37 user nova-compute[75734]:   </os>
Nov 22 16:15:37 user nova-compute[75734]:   <features>
Nov 22 16:15:37 user nova-compute[75734]:     <acpi/>
Nov 22 16:15:37 user nova-compute[75734]:     <apic/>
Nov 22 16:15:37 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:15:37 user nova-compute[75734]:   </features>
Nov 22 16:15:37 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:15:37 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:15:37 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:15:37 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:15:37 user nova-compute[75734]:   </clock>
Nov 22 16:15:37 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:15:37 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:15:37 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:15:37 user nova-compute[75734]:   </cpu>
Nov 22 16:15:37 user nova-compute[75734]:   <devices>
Nov 22 16:15:37 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:15:37 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:15:37 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk"/>
Nov 22 16:15:37 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:15:37 user nova-compute[75734]:     </disk>
Nov 22 16:15:37 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:15:37 user nova-compute[75734]:       <mac address="fa:16:3e:a5:f6:64"/>
Nov 22 16:15:37 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:15:37 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:15:37 user nova-compute[75734]:       <target dev="tap55a5ed43-8e"/>
Nov 22 16:15:37 user nova-compute[75734]:     </interface>
Nov 22 16:15:37 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:15:37 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/console.log" append="off"/>
Nov 22 16:15:37 user nova-compute[75734]:     </serial>
Nov 22 16:15:37 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:15:37 user nova-compute[75734]:     <video>
Nov 22 16:15:37 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:15:37 user nova-compute[75734]:     </video>
Nov 22 16:15:37 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:15:37 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:15:37 user nova-compute[75734]:     </rng>
Nov 22 16:15:37 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:15:37 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:15:37 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:15:37 user nova-compute[75734]:     </memballoon>
Nov 22 16:15:37 user nova-compute[75734]:   </devices>
Nov 22 16:15:37 user nova-compute[75734]: </domain>
Nov 22 16:15:37 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2058993008',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2058993008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2058993',id=38,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/xjWb5AjnKW18yUVkGARyQfJFT742Q/UYWRZf+VeB7KhZxqdzmYIcooHr7Z7zt3CYX5+HsyGCth0VnJYhjhidtLwy8kY56ecM1mue+KYmUL9OVhVoKkGLeUih07ftfwQ==',key_name='tempest-keypair-1361133888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de80a3ed83d34275b47766de30c4fe22',ramdisk_id='',reservation_id='r-6mk5g1wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1102009632',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85146896f44c438c8a76a24b1c1b2d20',uuid=01cdc407-771b-4793-bbf2-5fce1714da8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Converting VIF {"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5,network=Network(fd72e639-faae-4972-9ab4-ee8abdcf0333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a5ed43-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG os_vif [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5,network=Network(fd72e639-faae-4972-9ab4-ee8abdcf0333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a5ed43-8e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa368f72-83e4-5445-bb34-1a6f21338a16', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55a5ed43-8e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55a5ed43-8e, col_values=(('qos', UUID('e8dd4d4e-3e75-43ea-9adc-ed14883ad8b3')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55a5ed43-8e, col_values=(('external_ids', {'iface-id': '55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:f6:64', 'vm-uuid': '01cdc407-771b-4793-bbf2-5fce1714da8d'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:37 user nova-compute[75734]: INFO os_vif [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5,network=Network(fd72e639-faae-4972-9ab4-ee8abdcf0333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a5ed43-8e')
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] No VIF found with MAC fa:16:3e:a5:f6:64, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:15:37 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Instance spawned successfully.
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updated VIF entry in instance network info cache for port 55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updating instance_info_cache with network_info: [{"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:15:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-40a466cd-2438-42de-8f69-25ce4ddaa2bd req-78b877ea-18f4-41db-be6b-14870eae3c0e service nova] Releasing lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:15:37 user nova-compute[75734]: INFO nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 22 16:15:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:15:37 user nova-compute[75734]: INFO nova.compute.manager [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Took 6.32 seconds to build instance.
Nov 22 16:15:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dc6ba06d-aaaa-4f33-84c1-9ffbdf1cc155 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.426s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-cbb05136-bd9b-4120-acaf-83438b7e2baf req-981e6b0b-e0f1-40f1-ab4a-464c4dc52559 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:15:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cbb05136-bd9b-4120-acaf-83438b7e2baf req-981e6b0b-e0f1-40f1-ab4a-464c4dc52559 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cbb05136-bd9b-4120-acaf-83438b7e2baf req-981e6b0b-e0f1-40f1-ab4a-464c4dc52559 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cbb05136-bd9b-4120-acaf-83438b7e2baf req-981e6b0b-e0f1-40f1-ab4a-464c4dc52559 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-cbb05136-bd9b-4120-acaf-83438b7e2baf req-981e6b0b-e0f1-40f1-ab4a-464c4dc52559 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:15:38 user nova-compute[75734]: WARNING nova.compute.manager [req-cbb05136-bd9b-4120-acaf-83438b7e2baf req-981e6b0b-e0f1-40f1-ab4a-464c4dc52559 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received unexpected event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with vm_state active and task_state None.
Nov 22 16:15:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-ef396770-b50d-4a3d-9fbc-397451f19f17 req-10eff766-f39b-4939-acfa-d4abd4c51123 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef396770-b50d-4a3d-9fbc-397451f19f17 req-10eff766-f39b-4939-acfa-d4abd4c51123 service nova] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef396770-b50d-4a3d-9fbc-397451f19f17 req-10eff766-f39b-4939-acfa-d4abd4c51123 service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ef396770-b50d-4a3d-9fbc-397451f19f17 req-10eff766-f39b-4939-acfa-d4abd4c51123 service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-ef396770-b50d-4a3d-9fbc-397451f19f17 req-10eff766-f39b-4939-acfa-d4abd4c51123 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] No waiting events found dispatching network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:15:39 user nova-compute[75734]: WARNING nova.compute.manager [req-ef396770-b50d-4a3d-9fbc-397451f19f17 req-10eff766-f39b-4939-acfa-d4abd4c51123 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received unexpected event network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 for instance with vm_state building and task_state spawning.
Nov 22 16:15:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca93e55-6bdd-4076-bbd6-d512741e45e8 req-7acde810-d79c-417e-95ab-c59728ec2506 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:15:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca93e55-6bdd-4076-bbd6-d512741e45e8 req-7acde810-d79c-417e-95ab-c59728ec2506 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca93e55-6bdd-4076-bbd6-d512741e45e8 req-7acde810-d79c-417e-95ab-c59728ec2506 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fca93e55-6bdd-4076-bbd6-d512741e45e8 req-7acde810-d79c-417e-95ab-c59728ec2506 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-fca93e55-6bdd-4076-bbd6-d512741e45e8 req-7acde810-d79c-417e-95ab-c59728ec2506 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:15:40 user nova-compute[75734]: WARNING nova.compute.manager [req-fca93e55-6bdd-4076-bbd6-d512741e45e8 req-7acde810-d79c-417e-95ab-c59728ec2506 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received unexpected event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with vm_state active and task_state None.
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:15:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Instance spawned successfully.
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:15:41 user nova-compute[75734]: INFO nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e22c47d-3967-4611-82f2-16c0dcb3b1cc req-d0061e62-fd9d-457c-a5d6-e3b305671c89 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e22c47d-3967-4611-82f2-16c0dcb3b1cc req-d0061e62-fd9d-457c-a5d6-e3b305671c89 service nova] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e22c47d-3967-4611-82f2-16c0dcb3b1cc req-d0061e62-fd9d-457c-a5d6-e3b305671c89 service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e22c47d-3967-4611-82f2-16c0dcb3b1cc req-d0061e62-fd9d-457c-a5d6-e3b305671c89 service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e22c47d-3967-4611-82f2-16c0dcb3b1cc req-d0061e62-fd9d-457c-a5d6-e3b305671c89 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] No waiting events found dispatching network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:15:41 user nova-compute[75734]: WARNING nova.compute.manager [req-9e22c47d-3967-4611-82f2-16c0dcb3b1cc req-d0061e62-fd9d-457c-a5d6-e3b305671c89 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received unexpected event network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 for instance with vm_state building and task_state spawning.
Nov 22 16:15:41 user nova-compute[75734]: INFO nova.compute.manager [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Took 5.85 seconds to build instance.
Nov 22 16:15:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2556137f-a0a5-456b-b071-9d9e80e32c5e tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.946s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:15:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:15:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:15:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:15:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:15:58 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:16:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8186MB free_disk=25.001300811767578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance b039f669-d399-49f3-baf5-4a21c8847ab0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 6252f7b5-0458-42d4-8747-dfe425918dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0d53cd4b-c15a-4680-ae68-b115ca593a12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cf6e3423-f1dc-44ca-92df-2260155485e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 01cdc407-771b-4793-bbf2-5fce1714da8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:16:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:16:06 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid b039f669-d399-49f3-baf5-4a21c8847ab0 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [{"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-b039f669-d399-49f3-baf5-4a21c8847ab0" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:07 user nova-compute[75734]: INFO nova.compute.manager [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Terminating instance
Nov 22 16:16:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-747f5326-60d8-47a6-8032-f0b44810d84a req-0c20a0f8-b3ad-4378-8c27-69d5edaee085 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-unplugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-747f5326-60d8-47a6-8032-f0b44810d84a req-0c20a0f8-b3ad-4378-8c27-69d5edaee085 service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-747f5326-60d8-47a6-8032-f0b44810d84a req-0c20a0f8-b3ad-4378-8c27-69d5edaee085 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-747f5326-60d8-47a6-8032-f0b44810d84a req-0c20a0f8-b3ad-4378-8c27-69d5edaee085 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-747f5326-60d8-47a6-8032-f0b44810d84a req-0c20a0f8-b3ad-4378-8c27-69d5edaee085 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-unplugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-747f5326-60d8-47a6-8032-f0b44810d84a req-0c20a0f8-b3ad-4378-8c27-69d5edaee085 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-unplugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:16:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Instance destroyed successfully.
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'resources' on Instance uuid 6252f7b5-0458-42d4-8747-dfe425918dec {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1617189345',display_name='tempest-ServerActionsTestOtherA-server-1617189345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1617189345',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:11:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-jv06e6lr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=6252f7b5-0458-42d4-8747-dfe425918dec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "c2ad5c36-9639-489d-8106-02c283822b7a", "address": "fa:16:3e:23:0e:32", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ad5c36-96", "ovs_interfaceid": "c2ad5c36-9639-489d-8106-02c283822b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_vif [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ad5c36-96, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61db4439-1057-4933-8e5e-87249675f367) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:08 user nova-compute[75734]: INFO os_vif [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:32,bridge_name='br-int',has_traffic_filtering=True,id=c2ad5c36-9639-489d-8106-02c283822b7a,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ad5c36-96')
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdfTHDor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:16:08 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f27fb2-4c87-41b7-93ba-38e68f3f390d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:16:08 user nova-compute[75734]: No targets found.
Nov 22 16:16:08 user nova-compute[75734]: iSNS:
Nov 22 16:16:08 user nova-compute[75734]: No targets found.
Nov 22 16:16:08 user nova-compute[75734]: STATIC:
Nov 22 16:16:08 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b
Nov 22 16:16:08 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:16:08 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:16:08 user nova-compute[75734]: FIRMWARE:
Nov 22 16:16:08 user nova-compute[75734]: No targets found.
Nov 22 16:16:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:16:08 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:16:08 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[562e3214-0ed2-47a6-9fa8-d4688314bc70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc9639-30cf-4121-bd0c-9361b3ab2a93]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:16:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b (non-flash)
Nov 22 16:16:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac6b2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41ee2b0-6e65-4fa8-b10e-0afe53aae0fa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02f48c7-f48c-4152-a4ba-21865b803de6]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a32de5-30eb-4a35-aa52-17d1e1c9f785]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d566574-97b1-4a0f-8069-606fb7e11469]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe8b4ae31-e3673467f32892b2', '/dev/disk/by-id/scsi-26533363733343637', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e8b4ae31') {{(pid=86452) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30536a-dc71-4ae6-9c55-d263d4739832]: (4, None) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835f4b1-e79e-4b05-8b3a-dabc1decc51e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cdd4e3-3e15-472f-bf7d-52afa94c362e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260]
Nov 22 16:16:08 user nova-compute[75734]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b, portal: 172.16.0.220,3260] successful.
Nov 22 16:16:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65d80c36-68c3-46a2-8b5c-ff90cf51ea7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef0b96-01c8-4af7-92ea-abe9bf826c5b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] <== disconnect_volume: return (311ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:16:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Deleting instance files /opt/stack/data/nova/instances/6252f7b5-0458-42d4-8747-dfe425918dec_del
Nov 22 16:16:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Deletion of /opt/stack/data/nova/instances/6252f7b5-0458-42d4-8747-dfe425918dec_del complete
Nov 22 16:16:08 user nova-compute[75734]: INFO nova.compute.manager [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 22 16:16:08 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:16:08 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:16:09 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Took 0.64 seconds to deallocate network for instance.
Nov 22 16:16:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-e06481e2-d6dd-4a47-93d3-755b22ac46d8 req-ec5caf0b-285a-46fe-baac-81abc8094223 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-deleted-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:09 user nova-compute[75734]: INFO nova.compute.manager [req-e06481e2-d6dd-4a47-93d3-755b22ac46d8 req-ec5caf0b-285a-46fe-baac-81abc8094223 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Neutron deleted interface c2ad5c36-9639-489d-8106-02c283822b7a; detaching it from the instance and deleting it from the info cache
Nov 22 16:16:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-e06481e2-d6dd-4a47-93d3-755b22ac46d8 req-ec5caf0b-285a-46fe-baac-81abc8094223 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-e06481e2-d6dd-4a47-93d3-755b22ac46d8 req-ec5caf0b-285a-46fe-baac-81abc8094223 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Detach interface failed, port_id=c2ad5c36-9639-489d-8106-02c283822b7a, reason: Instance 6252f7b5-0458-42d4-8747-dfe425918dec could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "0d53cd4b-c15a-4680-ae68-b115ca593a12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:09 user nova-compute[75734]: INFO nova.compute.manager [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Terminating instance
Nov 22 16:16:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-320317ee-cd19-4f18-82aa-ded11e920614 req-6d40b819-0c18-4071-bd66-6f05f8b2beb1 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-320317ee-cd19-4f18-82aa-ded11e920614 req-6d40b819-0c18-4071-bd66-6f05f8b2beb1 service nova] Acquiring lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-320317ee-cd19-4f18-82aa-ded11e920614 req-6d40b819-0c18-4071-bd66-6f05f8b2beb1 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-320317ee-cd19-4f18-82aa-ded11e920614 req-6d40b819-0c18-4071-bd66-6f05f8b2beb1 service nova] Lock "6252f7b5-0458-42d4-8747-dfe425918dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-320317ee-cd19-4f18-82aa-ded11e920614 req-6d40b819-0c18-4071-bd66-6f05f8b2beb1 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] No waiting events found dispatching network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:16:09 user nova-compute[75734]: WARNING nova.compute.manager [req-320317ee-cd19-4f18-82aa-ded11e920614 req-6d40b819-0c18-4071-bd66-6f05f8b2beb1 service nova] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Received unexpected event network-vif-plugged-c2ad5c36-9639-489d-8106-02c283822b7a for instance with vm_state active and task_state deleting.
Nov 22 16:16:10 user nova-compute[75734]: INFO nova.compute.manager [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Took 0.83 seconds to detach 1 volumes for instance.
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: 6252f7b5-0458-42d4-8747-dfe425918dec] Deleting volume: 65d80c36-68c3-46a2-8b5c-ff90cf51ea7b {{(pid=75734) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 16:16:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Instance destroyed successfully.
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lazy-loading 'resources' on Instance uuid 0d53cd4b-c15a-4680-ae68-b115ca593a12 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1780019339',display_name='tempest-VolumesNegativeTest-instance-1780019339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1780019339',id=35,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9bf8c0e6c5c4b449e2c3a81a1dfcf43',ramdisk_id='',reservation_id='r-dtodx5pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1554866187',owner_user_name='tempest-VolumesNegativeTest-1554866187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:14:31Z,user_data=None,user_id='da55f9e4b84947fe93de3585d6588929',uuid=0d53cd4b-c15a-4680-ae68-b115ca593a12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Converting VIF {"id": "78659e1c-3e59-4349-b687-6b7799194df5", "address": "fa:16:3e:dc:92:76", "network": {"id": "b6f1d237-38c5-48f2-b5eb-2decdaf76c5e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "16df9f1ed66047ddbda80839130fece9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78659e1c-3e", "ovs_interfaceid": "78659e1c-3e59-4349-b687-6b7799194df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:76,bridge_name='br-int',has_traffic_filtering=True,id=78659e1c-3e59-4349-b687-6b7799194df5,network=Network(b6f1d237-38c5-48f2-b5eb-2decdaf76c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78659e1c-3e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG os_vif [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:76,bridge_name='br-int',has_traffic_filtering=True,id=78659e1c-3e59-4349-b687-6b7799194df5,network=Network(b6f1d237-38c5-48f2-b5eb-2decdaf76c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78659e1c-3e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78659e1c-3e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cb0828c-9fd0-4b16-a2c1-646a5a1a76b2) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:10 user nova-compute[75734]: INFO os_vif [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:76,bridge_name='br-int',has_traffic_filtering=True,id=78659e1c-3e59-4349-b687-6b7799194df5,network=Network(b6f1d237-38c5-48f2-b5eb-2decdaf76c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78659e1c-3e')
Nov 22 16:16:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Deleting instance files /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12_del
Nov 22 16:16:10 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Deletion of /opt/stack/data/nova/instances/0d53cd4b-c15a-4680-ae68-b115ca593a12_del complete
Nov 22 16:16:10 user nova-compute[75734]: INFO nova.compute.manager [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 22 16:16:10 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:10 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Deleted allocations for instance 6252f7b5-0458-42d4-8747-dfe425918dec
Nov 22 16:16:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8d004226-4e1e-4925-8250-49fb5deb8e0e tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "6252f7b5-0458-42d4-8747-dfe425918dec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.159s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:16:10 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Took 0.47 seconds to deallocate network for instance.
Nov 22 16:16:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:11 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Deleted allocations for instance 0d53cd4b-c15a-4680-ae68-b115ca593a12
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b2bd6279-4b17-4810-a65c-02e980c14f02 tempest-VolumesNegativeTest-1554866187 tempest-VolumesNegativeTest-1554866187-project-member] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received event network-vif-unplugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] Acquiring lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] No waiting events found dispatching network-vif-unplugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:16:11 user nova-compute[75734]: WARNING nova.compute.manager [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received unexpected event network-vif-unplugged-78659e1c-3e59-4349-b687-6b7799194df5 for instance with vm_state deleted and task_state None.
Nov 22 16:16:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received event network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] Acquiring lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] Lock "0d53cd4b-c15a-4680-ae68-b115ca593a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] No waiting events found dispatching network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:16:11 user nova-compute[75734]: WARNING nova.compute.manager [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received unexpected event network-vif-plugged-78659e1c-3e59-4349-b687-6b7799194df5 for instance with vm_state deleted and task_state None.
Nov 22 16:16:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-85cced44-25b2-483b-868a-2be55b356aa3 req-3af4847f-3cfd-41ef-872c-464a128fe5dd service nova] [instance: 0d53cd4b-c15a-4680-ae68-b115ca593a12] Received event network-vif-deleted-78659e1c-3e59-4349-b687-6b7799194df5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing instance network info cache due to event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:16:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] Acquiring lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:16:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] Acquired lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:16:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:16:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updated VIF entry in instance network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:16:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:16:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-69aca009-3fcf-4f3f-a513-a8fdd20933bc req-d72a8a12-a049-4ab6-905e-bc1784054c3c service nova] Releasing lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:16:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:21 user nova-compute[75734]: INFO nova.compute.manager [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Shelving
Nov 22 16:16:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-f660e716-5af3-40f0-b052-280decab7abd req-b8269810-a5bc-4e1c-82e0-76297090cd80 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-unplugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f660e716-5af3-40f0-b052-280decab7abd req-b8269810-a5bc-4e1c-82e0-76297090cd80 service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f660e716-5af3-40f0-b052-280decab7abd req-b8269810-a5bc-4e1c-82e0-76297090cd80 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f660e716-5af3-40f0-b052-280decab7abd req-b8269810-a5bc-4e1c-82e0-76297090cd80 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-f660e716-5af3-40f0-b052-280decab7abd req-b8269810-a5bc-4e1c-82e0-76297090cd80 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-unplugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:16:21 user nova-compute[75734]: WARNING nova.compute.manager [req-f660e716-5af3-40f0-b052-280decab7abd req-b8269810-a5bc-4e1c-82e0-76297090cd80 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received unexpected event network-vif-unplugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with vm_state active and task_state shelving.
Nov 22 16:16:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:21 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance destroyed successfully.
Nov 22 16:16:21 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Beginning cold snapshot process
Nov 22 16:16:22 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:16:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk /opt/stack/data/nova/instances/snapshots/tmpnof4i8t6/1ee504291c434e1cbd0c750fbf32068f {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:16:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk /opt/stack/data/nova/instances/snapshots/tmpnof4i8t6/1ee504291c434e1cbd0c750fbf32068f" returned: 0 in 0.895s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:16:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Snapshot extracted, beginning image upload
Nov 22 16:16:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-602aa7d7-422b-41a9-ae4f-4df708bcbd46 req-65e4862c-afc5-4a1d-aeb7-7dff0f9a151f service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-602aa7d7-422b-41a9-ae4f-4df708bcbd46 req-65e4862c-afc5-4a1d-aeb7-7dff0f9a151f service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-602aa7d7-422b-41a9-ae4f-4df708bcbd46 req-65e4862c-afc5-4a1d-aeb7-7dff0f9a151f service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-602aa7d7-422b-41a9-ae4f-4df708bcbd46 req-65e4862c-afc5-4a1d-aeb7-7dff0f9a151f service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-602aa7d7-422b-41a9-ae4f-4df708bcbd46 req-65e4862c-afc5-4a1d-aeb7-7dff0f9a151f service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:16:23 user nova-compute[75734]: WARNING nova.compute.manager [req-602aa7d7-422b-41a9-ae4f-4df708bcbd46 req-65e4862c-afc5-4a1d-aeb7-7dff0f9a151f service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received unexpected event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 22 16:16:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Snapshot image upload complete
Nov 22 16:16:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:16:25 user nova-compute[75734]: INFO nova.compute.manager [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Shelve offloading
Nov 22 16:16:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance destroyed successfully.
Nov 22 16:16:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:16:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:16:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquired lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:16:25 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Releasing lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance destroyed successfully.
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.objects.instance [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'resources' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-214828451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-214828451',id=36,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlRIlbTs8pi6TX58kK7DfgmNp7Sv050i5Di2/sbU7f9f4Ov7HydeCH8+m0BgG4BmayXiOsTi5gZ4YosZBZLsqf/JYx7DMRm2Vxhu+hPSa5hNODo6a5DsBfqcNV3X+QEjA==',key_name='tempest-keypair-1751822900',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:14:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-x90dzzuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member',shelved_at='2023-11-22T16:16:25.525778',shelved_host='user',shelved_image_id='60ed148d-aa3b-4c60-b4dd-e55fa57b374e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=cf6e3423-f1dc-44ca-92df-2260155485e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG os_vif [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a2737fe-70, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19f0413a-b436-40a8-b939-fd5b557980c4) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing instance network info cache due to event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] Acquiring lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] Acquired lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:16:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:26 user nova-compute[75734]: INFO os_vif [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70')
Nov 22 16:16:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Deleting instance files /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5_del
Nov 22 16:16:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Deletion of /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5_del complete
Nov 22 16:16:26 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Deleted allocations for instance cf6e3423-f1dc-44ca-92df-2260155485e5
Nov 22 16:16:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG nova.objects.instance [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'numa_topology' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG nova.objects.base [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<cf6e3423-f1dc-44ca-92df-2260155485e5> lazy-loaded attributes: resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updated VIF entry in instance network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2a2737fe-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-040abfa6-4944-4e1f-a5e6-5e74b0007ea0 req-d0c4cea6-735a-42d8-a25c-5ed7cd03da0d service nova] Releasing lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:16:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dcd12198-636a-4501-a364-1c1285bf9610 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.969s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:16:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:16:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:16:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:16:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:16:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:16:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:16:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:17:00 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:01 user nova-compute[75734]: INFO nova.compute.manager [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Terminating instance
Nov 22 16:17:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-2b0890d7-a2df-4d00-bfee-ea37fce36a9c req-45f68804-e358-49a8-99de-d33fa66adfbe service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-vif-unplugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2b0890d7-a2df-4d00-bfee-ea37fce36a9c req-45f68804-e358-49a8-99de-d33fa66adfbe service nova] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2b0890d7-a2df-4d00-bfee-ea37fce36a9c req-45f68804-e358-49a8-99de-d33fa66adfbe service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2b0890d7-a2df-4d00-bfee-ea37fce36a9c req-45f68804-e358-49a8-99de-d33fa66adfbe service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-2b0890d7-a2df-4d00-bfee-ea37fce36a9c req-45f68804-e358-49a8-99de-d33fa66adfbe service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] No waiting events found dispatching network-vif-unplugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-2b0890d7-a2df-4d00-bfee-ea37fce36a9c req-45f68804-e358-49a8-99de-d33fa66adfbe service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-vif-unplugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Instance destroyed successfully.
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.objects.instance [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lazy-loading 'resources' on Instance uuid b039f669-d399-49f3-baf5-4a21c8847ab0 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-466203827',display_name='tempest-ServerActionsTestOtherA-server-466203827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-466203827',id=16,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaqSAI/Iuji68oFABMCI8ItMMeUi+KsIMLcfAgEkNJx/D/h2dujVrBZAvsSsnaUwEb6HIPQAVaUs/DY+hty+6CZ2EaOTf8hAbuZVpSeXMmANzGLsSVv3+Dt7Mq6RszG0A==',key_name='tempest-keypair-688138166',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82865952d35349ffa829cf563d829fbe',ramdisk_id='',reservation_id='r-qkqauffb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2146149591',owner_user_name='tempest-ServerActionsTestOtherA-2146149591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9891b862488466e8e46427bbd19f742',uuid=b039f669-d399-49f3-baf5-4a21c8847ab0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converting VIF {"id": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "address": "fa:16:3e:a7:6c:21", "network": {"id": "e24e7178-e0ac-4c6d-9d96-7dd0244551bc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-851351445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82865952d35349ffa829cf563d829fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ae1c222-8e", "ovs_interfaceid": "9ae1c222-8eca-4705-88d5-e43f1819c1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:6c:21,bridge_name='br-int',has_traffic_filtering=True,id=9ae1c222-8eca-4705-88d5-e43f1819c1ff,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ae1c222-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG os_vif [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:6c:21,bridge_name='br-int',has_traffic_filtering=True,id=9ae1c222-8eca-4705-88d5-e43f1819c1ff,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ae1c222-8e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ae1c222-8e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4485bde3-c97b-4662-b027-4f382807c3ed) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:17:02 user nova-compute[75734]: INFO os_vif [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:6c:21,bridge_name='br-int',has_traffic_filtering=True,id=9ae1c222-8eca-4705-88d5-e43f1819c1ff,network=Network(e24e7178-e0ac-4c6d-9d96-7dd0244551bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ae1c222-8e')
Nov 22 16:17:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Deleting instance files /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0_del
Nov 22 16:17:02 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Deletion of /opt/stack/data/nova/instances/b039f669-d399-49f3-baf5-4a21c8847ab0_del complete
Nov 22 16:17:02 user nova-compute[75734]: INFO nova.compute.manager [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-188eaea5-127f-4470-8cd1-a6745e611cab req-98db6927-ce12-4319-9852-ad5f9758db86 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-vif-deleted-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:17:02 user nova-compute[75734]: INFO nova.compute.manager [req-188eaea5-127f-4470-8cd1-a6745e611cab req-98db6927-ce12-4319-9852-ad5f9758db86 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Neutron deleted interface 9ae1c222-8eca-4705-88d5-e43f1819c1ff; detaching it from the instance and deleting it from the info cache
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.network.neutron [req-188eaea5-127f-4470-8cd1-a6745e611cab req-98db6927-ce12-4319-9852-ad5f9758db86 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:17:02 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Took 0.57 seconds to deallocate network for instance.
Nov 22 16:17:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-188eaea5-127f-4470-8cd1-a6745e611cab req-98db6927-ce12-4319-9852-ad5f9758db86 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Detach interface failed, port_id=9ae1c222-8eca-4705-88d5-e43f1819c1ff, reason: Instance b039f669-d399-49f3-baf5-4a21c8847ab0 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:03 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Deleted allocations for instance b039f669-d399-49f3-baf5-4a21c8847ab0
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-20034989-ae4a-4626-8888-70c5e50abffd tempest-ServerActionsTestOtherA-2146149591 tempest-ServerActionsTestOtherA-2146149591-project-member] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-c0f401f8-0b10-4c90-82be-5643697edc36 req-2c1d5409-dee6-4250-a7a7-5625b6241a58 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received event network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c0f401f8-0b10-4c90-82be-5643697edc36 req-2c1d5409-dee6-4250-a7a7-5625b6241a58 service nova] Acquiring lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c0f401f8-0b10-4c90-82be-5643697edc36 req-2c1d5409-dee6-4250-a7a7-5625b6241a58 service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c0f401f8-0b10-4c90-82be-5643697edc36 req-2c1d5409-dee6-4250-a7a7-5625b6241a58 service nova] Lock "b039f669-d399-49f3-baf5-4a21c8847ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG nova.compute.manager [req-c0f401f8-0b10-4c90-82be-5643697edc36 req-2c1d5409-dee6-4250-a7a7-5625b6241a58 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] No waiting events found dispatching network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:17:03 user nova-compute[75734]: WARNING nova.compute.manager [req-c0f401f8-0b10-4c90-82be-5643697edc36 req-2c1d5409-dee6-4250-a7a7-5625b6241a58 service nova] [instance: b039f669-d399-49f3-baf5-4a21c8847ab0] Received unexpected event network-vif-plugged-9ae1c222-8eca-4705-88d5-e43f1819c1ff for instance with vm_state deleted and task_state None.
Nov 22 16:17:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:17:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:17:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.033016204833984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 01cdc407-771b-4793-bbf2-5fce1714da8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:17:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:17:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:17:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updating instance_info_cache with network_info: [{"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:17:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:17:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:17:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:17:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-changed-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:17:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Refreshing instance network info cache due to event network-changed-0ae1c41c-7eb1-41e3-8289-286d56e8cf42. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:17:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] Acquiring lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:17:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] Acquired lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:17:21 user nova-compute[75734]: DEBUG nova.network.neutron [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Refreshing network info cache for port 0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'flavor' on Instance uuid fc7bf3ae-9441-4fc5-acfd-b0db023065d3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:17:22 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Ignoring supplied device name: /dev/vdb
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updated VIF entry in instance network info cache for port 0ae1c41c-7eb1-41e3-8289-286d56e8cf42. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG nova.network.neutron [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updating instance_info_cache with network_info: [{"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:22 user nova-compute[75734]: INFO nova.compute.manager [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Attaching volume 6050883f-a120-4d5e-aa32-7ac0ea703e7b to /dev/vdb
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bde2e1df-b5b3-49d0-b1c8-3cb94ad956d2 req-2b9e553e-e3c2-4af4-97ae-42428aa02692 service nova] Releasing lock "refresh_cache-fc7bf3ae-9441-4fc5-acfd-b0db023065d3" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG os_brick.utils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b067b11-532a-48bd-89d4-ce1a119d0668]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7df52b-95bf-4a64-8c8f-8b26bdc3f791]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[40301aef-9846-429b-8641-d5b9ca5832da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8989165c-18d6-4b97-aacc-4d4effce0ecf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:17:22 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:17:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fec85e-6dd8-42a6-b877-ee1e7a8fcbf0]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG os_brick.utils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:17:22 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updating existing volume attachment record: b476327c-1f0a-4a95-8030-669681fb40b3 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-changed-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Refreshing instance network info cache due to event network-changed-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] Acquiring lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] Acquired lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Refreshing network info cache for port 55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updated VIF entry in instance network info cache for port 55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updating instance_info_cache with network_info: [{"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0a5b2ff1-f31b-47dc-b40a-f4a389d5302e req-c1f578b1-5cb1-40ed-bddf-2b62a396fa39 service nova] Releasing lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:17:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuEzhqWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:17:28 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:17:28 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:17:28 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf93799-997c-42ed-b549-e76889047295]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:17:28 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11331c2-95d8-405d-bd8b-adb1b7854c32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b] added
Nov 22 16:17:28 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd59120d-3ddd-4fa8-9998-26b10e9e0117]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5a6fd-a654-44be-8dc3-aa51c711796e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuEzhqWT {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuEzhqWT" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dcc4f5-dca1-4734-98d4-654064082027]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cuEzhqWT'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab82438-5a40-405d-8c88-dc96d011e690]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb69d2c-d264-489c-9b2a-b26ddb88992f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:17:28 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:17:28 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:17:28 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:17:28 user nova-compute[75734]: 
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ddc22-1b0c-48d6-ba11-6e18edba9a83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260]
Nov 22 16:17:28 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260] successful.
Nov 22 16:17:28 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa9f06e-eb30-418c-9a9e-33418d53d27f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[860dd77a-a673-45ce-9ee0-a52608eb6450]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:17:28 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:17:28 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f1508-e040-432d-a936-24a1b7257f74]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:17:28 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuEzhqWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:17:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:17:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26130616636383030', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:17:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130616636383030', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:17:29 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'flavor' on Instance uuid fc7bf3ae-9441-4fc5-acfd-b0db023065d3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:17:29 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:17:29 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:17:29 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:17:29 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:17:29 user nova-compute[75734]:   <serial>6050883f-a120-4d5e-aa32-7ac0ea703e7b</serial>
Nov 22 16:17:29 user nova-compute[75734]: </disk>
Nov 22 16:17:29 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] No VIF found with MAC fa:16:3e:a9:81:9b, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c76968fa-8cf8-4a73-a12a-ed44b881714d tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.764s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG nova.objects.instance [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lazy-loading 'flavor' on Instance uuid 01cdc407-771b-4793-bbf2-5fce1714da8d {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:30 user nova-compute[75734]: INFO nova.compute.manager [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Attaching volume dfe1114b-f9f1-4f92-896b-34c8bff5ce70 to /dev/vdb
Nov 22 16:17:30 user nova-compute[75734]: DEBUG os_brick.utils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aded8256-cbd1-4d60-9813-361f871b78c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e2e268-b0d7-4fa3-b641-cf05b3122fea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[df872f51-c1e4-4453-a233-b92c091bed87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c477d554-e487-445e-bd42-9c2dfbc322e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:17:30 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:17:30 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[55304e0d-d8b2-4c0f-a29a-ef4950e0e593]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG os_brick.utils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:17:30 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updating existing volume attachment record: 4618dd90-c47a-4953-8b84-751c372b92ac {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:17:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJvFoMHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:17:36 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:17:36 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:17:36 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201e8f5-c595-4f76-b91e-4c4f28a765b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:17:36 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ecf089-7525-41e4-8818-fa6d9fa13e3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70] added
Nov 22 16:17:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f12fc1-b634-43f6-92d3-f540c1826b12]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d9f43e-68bc-4ea8-a1c0-3f5603ab6326]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJvFoMHT {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJvFoMHT" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4b98d2-e606-4951-a8de-c5347f99b368]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJvFoMHT'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb29cf0-34ad-490e-88ea-a2d28fdc0ce9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd64b6-628e-4373-99cf-d7a8b3b1898d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:17:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:17:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[697bf8e9-a16b-4b4c-b028-efa8ec662fa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260]
Nov 22 16:17:36 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260] successful.
Nov 22 16:17:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[45303e39-d5f0-4930-8ce4-8a5220322951]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc69af1-41ad-490c-a974-566ca8015f6b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:17:36 user nova-compute[75734]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 (non-flash)
Nov 22 16:17:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:17:36 user nova-compute[75734]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 (non-flash)
Nov 22 16:17:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9526559-f256-4b6c-8ec0-7c6abb74a122]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:17:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJvFoMHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:17:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:17:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23038623733613532', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:17:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038623733613532', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:17:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lazy-loading 'flavor' on Instance uuid 01cdc407-771b-4793-bbf2-5fce1714da8d {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:17:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:17:38 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:17:38 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:17:38 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:17:38 user nova-compute[75734]:   <serial>dfe1114b-f9f1-4f92-896b-34c8bff5ce70</serial>
Nov 22 16:17:38 user nova-compute[75734]: </disk>
Nov 22 16:17:38 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:17:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:17:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:17:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] No VIF found with MAC fa:16:3e:a5:f6:64, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:17:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-364d5483-a29a-486f-b621-efad45ea47de tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.785s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:17:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:40 user nova-compute[75734]: INFO nova.compute.manager [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Detaching volume dfe1114b-f9f1-4f92-896b-34c8bff5ce70
Nov 22 16:17:40 user nova-compute[75734]: INFO nova.virt.block_device [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Attempting to driver detach volume dfe1114b-f9f1-4f92-896b-34c8bff5ce70 from mountpoint /dev/vdb
Nov 22 16:17:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Attempting to detach device vdb from instance 01cdc407-771b-4793-bbf2-5fce1714da8d from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:17:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:17:40 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:17:40 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:17:40 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:17:40 user nova-compute[75734]:   <serial>dfe1114b-f9f1-4f92-896b-34c8bff5ce70</serial>
Nov 22 16:17:40 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:17:40 user nova-compute[75734]: </disk>
Nov 22 16:17:40 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:17:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Successfully detached device vdb from instance 01cdc407-771b-4793-bbf2-5fce1714da8d from the persistent domain config.
Nov 22 16:17:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01cdc407-771b-4793-bbf2-5fce1714da8d from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:17:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:17:40 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:17:40 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:17:40 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:17:40 user nova-compute[75734]:   <serial>dfe1114b-f9f1-4f92-896b-34c8bff5ce70</serial>
Nov 22 16:17:40 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:17:40 user nova-compute[75734]: </disk>
Nov 22 16:17:40 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:17:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01cdc407-771b-4793-bbf2-5fce1714da8d {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:17:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:17:46 user nova-compute[75734]: INFO nova.compute.manager [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Detaching volume 6050883f-a120-4d5e-aa32-7ac0ea703e7b
Nov 22 16:17:46 user nova-compute[75734]: INFO nova.virt.block_device [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Attempting to driver detach volume 6050883f-a120-4d5e-aa32-7ac0ea703e7b from mountpoint /dev/vdb
Nov 22 16:17:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Attempting to detach device vdb from instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:17:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:17:46 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:17:46 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:17:46 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:17:46 user nova-compute[75734]:   <serial>6050883f-a120-4d5e-aa32-7ac0ea703e7b</serial>
Nov 22 16:17:46 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:17:46 user nova-compute[75734]: </disk>
Nov 22 16:17:46 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:17:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:17:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully detached device vdb from instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 from the persistent domain config.
Nov 22 16:17:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:17:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:17:46 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:17:46 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:17:46 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:17:46 user nova-compute[75734]:   <serial>6050883f-a120-4d5e-aa32-7ac0ea703e7b</serial>
Nov 22 16:17:46 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:17:46 user nova-compute[75734]: </disk>
Nov 22 16:17:46 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:17:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:17:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:17:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:17:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:17:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:17:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:17:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01cdc407-771b-4793-bbf2-5fce1714da8d is timed out.
Nov 22 16:18:00 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Successfully detached device vdb from instance 01cdc407-771b-4793-bbf2-5fce1714da8d from the live domain config.
Nov 22 16:18:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJvFoMHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:18:00 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa38bb9-79fe-4ac2-8ee7-c9947f82ef0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:18:00 user nova-compute[75734]: No targets found.
Nov 22 16:18:00 user nova-compute[75734]: iSNS:
Nov 22 16:18:00 user nova-compute[75734]: No targets found.
Nov 22 16:18:00 user nova-compute[75734]: STATIC:
Nov 22 16:18:00 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b
Nov 22 16:18:00 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:18:00 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:18:00 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70
Nov 22 16:18:00 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:18:00 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:18:00 user nova-compute[75734]: FIRMWARE:
Nov 22 16:18:00 user nova-compute[75734]: No targets found.
Nov 22 16:18:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:18:00 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:18:00 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692b6a2-e0b8-40d6-a50f-14d412b83333]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[881da064-b42a-47d0-bab6-098af33e31af]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:18:00 user nova-compute[75734]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 (non-flash)
Nov 22 16:18:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:18:00 user nova-compute[75734]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 (non-flash)
Nov 22 16:18:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc3d7910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[669e7e3a-7e13-458d-b7b8-2fa48a49770d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a4171-e560-4436-99eb-a35a5daf227e]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e814ba71-22de-4cce-8ca5-f30c0d811aa0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:18:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ccd35-8add-47c3-b176-ac10ed6f76c3]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[da666555-862d-4ecb-964f-2ffc62d9c1d1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1b26a1-add3-43ca-99fb-1e102a3538c9]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260]
Nov 22 16:18:01 user nova-compute[75734]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70, portal: 172.16.0.220,3260] successful.
Nov 22 16:18:01 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe1114b-f9f1-4f92-896b-34c8bff5ce70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce26aff-77f0-487d-80e5-fd2978e65c6d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] <== disconnect_volume: return (329ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:01 user nova-compute[75734]: DEBUG nova.objects.instance [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lazy-loading 'flavor' on Instance uuid 01cdc407-771b-4793-bbf2-5fce1714da8d {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7cbf4a32-c80d-43ee-b2ec-75126d7cd58c tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:02 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:18:03 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:18:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.029685974121094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 01cdc407-771b-4793-bbf2-5fce1714da8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.183s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:18:04 user nova-compute[75734]: INFO nova.compute.claims [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Claim successful on node user
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:18:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.policy [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13537e19b07644f98c75a15811352411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f32004419348dcbf74b4f71f80fac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:18:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Creating image(s)
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "/opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "/opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk 1073741824" returned: 0 in 0.060s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Successfully created port: a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.172s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Cannot resize image /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Ensure instance console log exists: /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Successfully updated port: a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquired lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received event network-changed-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG nova.compute.manager [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Refreshing instance network info cache due to event network-changed-a5bfb4b3-2832-478d-97f4-fea8e9e73a17. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:18:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] Acquiring lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Releasing lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Instance network_info: |[{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] Acquired lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Refreshing network info cache for port a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Start _get_guest_xml network_info=[{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:18:06 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:18:06 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1681697981',display_name='tempest-ServersNegativeTestJSON-server-1681697981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1681697981',id=39,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f32004419348dcbf74b4f71f80fac7',ramdisk_id='',reservation_id='r-20vmnb26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-652450684',owner_user_name='tempest-ServersNegativeTestJSON-652450684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:18:05Z,user_data=None,user_id='13537e19b07644f98c75a15811352411',uuid=2d3aa4ee-d620-41af-a9bd-42da727a7f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converting VIF {"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bfb4b3-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d3aa4ee-d620-41af-a9bd-42da727a7f7c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:18:06 user nova-compute[75734]:   <uuid>2d3aa4ee-d620-41af-a9bd-42da727a7f7c</uuid>
Nov 22 16:18:06 user nova-compute[75734]:   <name>instance-00000027</name>
Nov 22 16:18:06 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:18:06 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:18:06 user nova-compute[75734]:   <metadata>
Nov 22 16:18:06 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:18:06 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:18:06 user nova-compute[75734]:       <nova:name>tempest-ServersNegativeTestJSON-server-1681697981</nova:name>
Nov 22 16:18:06 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:18:06</nova:creationTime>
Nov 22 16:18:06 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:18:06 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:18:06 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:18:06 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:18:06 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:18:06 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:18:06 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:18:06 user nova-compute[75734]:       <nova:owner>
Nov 22 16:18:06 user nova-compute[75734]:         <nova:user uuid="13537e19b07644f98c75a15811352411">tempest-ServersNegativeTestJSON-652450684-project-member</nova:user>
Nov 22 16:18:06 user nova-compute[75734]:         <nova:project uuid="05f32004419348dcbf74b4f71f80fac7">tempest-ServersNegativeTestJSON-652450684</nova:project>
Nov 22 16:18:06 user nova-compute[75734]:       </nova:owner>
Nov 22 16:18:06 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:18:06 user nova-compute[75734]:       <nova:ports>
Nov 22 16:18:06 user nova-compute[75734]:         <nova:port uuid="a5bfb4b3-2832-478d-97f4-fea8e9e73a17">
Nov 22 16:18:06 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:18:06 user nova-compute[75734]:         </nova:port>
Nov 22 16:18:06 user nova-compute[75734]:       </nova:ports>
Nov 22 16:18:06 user nova-compute[75734]:     </nova:instance>
Nov 22 16:18:06 user nova-compute[75734]:   </metadata>
Nov 22 16:18:06 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:18:06 user nova-compute[75734]:     <system>
Nov 22 16:18:06 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:18:06 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:18:06 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:18:06 user nova-compute[75734]:       <entry name="serial">2d3aa4ee-d620-41af-a9bd-42da727a7f7c</entry>
Nov 22 16:18:06 user nova-compute[75734]:       <entry name="uuid">2d3aa4ee-d620-41af-a9bd-42da727a7f7c</entry>
Nov 22 16:18:06 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:18:06 user nova-compute[75734]:     </system>
Nov 22 16:18:06 user nova-compute[75734]:   </sysinfo>
Nov 22 16:18:06 user nova-compute[75734]:   <os>
Nov 22 16:18:06 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:18:06 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:18:06 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:18:06 user nova-compute[75734]:   </os>
Nov 22 16:18:06 user nova-compute[75734]:   <features>
Nov 22 16:18:06 user nova-compute[75734]:     <acpi/>
Nov 22 16:18:06 user nova-compute[75734]:     <apic/>
Nov 22 16:18:06 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:18:06 user nova-compute[75734]:   </features>
Nov 22 16:18:06 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:18:06 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:18:06 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:18:06 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:18:06 user nova-compute[75734]:   </clock>
Nov 22 16:18:06 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:18:06 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:18:06 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:18:06 user nova-compute[75734]:   </cpu>
Nov 22 16:18:06 user nova-compute[75734]:   <devices>
Nov 22 16:18:06 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:18:06 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:18:06 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk"/>
Nov 22 16:18:06 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:18:06 user nova-compute[75734]:     </disk>
Nov 22 16:18:06 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:18:06 user nova-compute[75734]:       <mac address="fa:16:3e:85:94:e3"/>
Nov 22 16:18:06 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:18:06 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:18:06 user nova-compute[75734]:       <target dev="tapa5bfb4b3-28"/>
Nov 22 16:18:06 user nova-compute[75734]:     </interface>
Nov 22 16:18:06 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:18:06 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/console.log" append="off"/>
Nov 22 16:18:06 user nova-compute[75734]:     </serial>
Nov 22 16:18:06 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:18:06 user nova-compute[75734]:     <video>
Nov 22 16:18:06 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:18:06 user nova-compute[75734]:     </video>
Nov 22 16:18:06 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:18:06 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:18:06 user nova-compute[75734]:     </rng>
Nov 22 16:18:06 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:18:06 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:18:06 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:18:06 user nova-compute[75734]:     </memballoon>
Nov 22 16:18:06 user nova-compute[75734]:   </devices>
Nov 22 16:18:06 user nova-compute[75734]: </domain>
Nov 22 16:18:06 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1681697981',display_name='tempest-ServersNegativeTestJSON-server-1681697981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1681697981',id=39,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f32004419348dcbf74b4f71f80fac7',ramdisk_id='',reservation_id='r-20vmnb26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-652450684',owner_user_name='tempest-ServersNegativeTestJSON-652450684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:18:05Z,user_data=None,user_id='13537e19b07644f98c75a15811352411',uuid=2d3aa4ee-d620-41af-a9bd-42da727a7f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converting VIF {"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bfb4b3-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG os_vif [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bfb4b3-28') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '242f5948-d297-5eb5-8292-3f25f723737a', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5bfb4b3-28, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5bfb4b3-28, col_values=(('qos', UUID('2679d2ec-0dc9-473f-b7cc-c05197a25e5c')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5bfb4b3-28, col_values=(('external_ids', {'iface-id': 'a5bfb4b3-2832-478d-97f4-fea8e9e73a17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:94:e3', 'vm-uuid': '2d3aa4ee-d620-41af-a9bd-42da727a7f7c'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:06 user nova-compute[75734]: INFO os_vif [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bfb4b3-28')
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] No VIF found with MAC fa:16:3e:85:94:e3, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updated VIF entry in instance network info cache for port a5bfb4b3-2832-478d-97f4-fea8e9e73a17. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-48d44571-a492-4261-bdc6-685f06321eb4 req-22f699b6-1c0e-476e-add9-9819b221c67d service nova] Releasing lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:18:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 is timed out.
Nov 22 16:18:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully detached device vdb from instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 from the live domain config.
Nov 22 16:18:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuEzhqWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:18:07 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d34585-4bc0-492b-9cf8-5789a59706fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:18:07 user nova-compute[75734]: No targets found.
Nov 22 16:18:07 user nova-compute[75734]: iSNS:
Nov 22 16:18:07 user nova-compute[75734]: No targets found.
Nov 22 16:18:07 user nova-compute[75734]: STATIC:
Nov 22 16:18:07 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b
Nov 22 16:18:07 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:18:07 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:18:07 user nova-compute[75734]: FIRMWARE:
Nov 22 16:18:07 user nova-compute[75734]: No targets found.
Nov 22 16:18:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:18:07 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:18:07 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9bf8a2-3d08-460a-b262-a314af767ee1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updating instance_info_cache with network_info: [{"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-01cdc407-771b-4793-bbf2-5fce1714da8d" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c9e4ab-9ca4-4a57-93ae-96e642658948]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:18:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b (non-flash)
Nov 22 16:18:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc083a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7232a800-8c28-40d9-8b00-bcd877285300]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5874f8f0-71f8-40aa-83c7-b39f89499702]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d8ab6-0537-4aa1-a825-b843d36c7fd3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f17655f-120f-45b3-a15d-993bc8f76786]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a9b66a-3877-4a18-bc43-a885af6a3cd8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[96244bca-1d82-4244-931f-ba6aa6057b9b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260]
Nov 22 16:18:07 user nova-compute[75734]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b, portal: 172.16.0.220,3260] successful.
Nov 22 16:18:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16e88f2-739d-4010-b80e-b055d2ad1d07]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== disconnect_volume: return (291ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-32f91cf8-09c2-4367-bd6b-738042e00a54 req-92cc0636-1109-40d1-96a1-0982bc0c25ec service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received event network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-32f91cf8-09c2-4367-bd6b-738042e00a54 req-92cc0636-1109-40d1-96a1-0982bc0c25ec service nova] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-32f91cf8-09c2-4367-bd6b-738042e00a54 req-92cc0636-1109-40d1-96a1-0982bc0c25ec service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-32f91cf8-09c2-4367-bd6b-738042e00a54 req-92cc0636-1109-40d1-96a1-0982bc0c25ec service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-32f91cf8-09c2-4367-bd6b-738042e00a54 req-92cc0636-1109-40d1-96a1-0982bc0c25ec service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] No waiting events found dispatching network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:07 user nova-compute[75734]: WARNING nova.compute.manager [req-32f91cf8-09c2-4367-bd6b-738042e00a54 req-92cc0636-1109-40d1-96a1-0982bc0c25ec service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received unexpected event network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 for instance with vm_state building and task_state spawning.
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.objects.instance [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'flavor' on Instance uuid fc7bf3ae-9441-4fc5-acfd-b0db023065d3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-75bac7e7-f642-4cd9-baf8-33de63bcc874 tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.728s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:08 user nova-compute[75734]: INFO nova.compute.manager [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Terminating instance
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-5bd4bfb3-95fa-447e-9a71-2eaa2e68d58e req-71d51d9e-7f70-4bf3-b8b1-9bb86256d4c9 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-unplugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5bd4bfb3-95fa-447e-9a71-2eaa2e68d58e req-71d51d9e-7f70-4bf3-b8b1-9bb86256d4c9 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5bd4bfb3-95fa-447e-9a71-2eaa2e68d58e req-71d51d9e-7f70-4bf3-b8b1-9bb86256d4c9 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-5bd4bfb3-95fa-447e-9a71-2eaa2e68d58e req-71d51d9e-7f70-4bf3-b8b1-9bb86256d4c9 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-5bd4bfb3-95fa-447e-9a71-2eaa2e68d58e req-71d51d9e-7f70-4bf3-b8b1-9bb86256d4c9 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-unplugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-5bd4bfb3-95fa-447e-9a71-2eaa2e68d58e req-71d51d9e-7f70-4bf3-b8b1-9bb86256d4c9 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-unplugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Instance destroyed successfully.
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lazy-loading 'resources' on Instance uuid fc7bf3ae-9441-4fc5-acfd-b0db023065d3 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1685049613',display_name='tempest-VolumesSnapshotTestJSON-instance-1685049613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1685049613',id=37,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIudemC8uB0e8w7vOdbsHoTbfD8MdxqWLOdSbt2gwp7pyMROwRvusgOmxvPv5ZohF3tcH1//doCCAGeZQxmzCEWMcN+4w4w9SlIEyIuNaksGnE5Np+G7oMgj+RzOqagIQQ==',key_name='tempest-keypair-539409635',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='866f8883870d4feebe60b3fb3031f8d3',ramdisk_id='',reservation_id='r-fxc0kcoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1189754321',owner_user_name='tempest-VolumesSnapshotTestJSON-1189754321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:15:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='034f9dedcf294f7093e65368c74abb47',uuid=fc7bf3ae-9441-4fc5-acfd-b0db023065d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converting VIF {"id": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "address": "fa:16:3e:a9:81:9b", "network": {"id": "ab71171e-f0f5-414d-bcc8-368b914c6c53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1008836582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "866f8883870d4feebe60b3fb3031f8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ae1c41c-7e", "ovs_interfaceid": "0ae1c41c-7eb1-41e3-8289-286d56e8cf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:81:9b,bridge_name='br-int',has_traffic_filtering=True,id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ae1c41c-7e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG os_vif [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:81:9b,bridge_name='br-int',has_traffic_filtering=True,id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ae1c41c-7e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ae1c41c-7e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=615a94b4-1d15-4020-a4a5-330c596ad6cc) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: INFO os_vif [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:81:9b,bridge_name='br-int',has_traffic_filtering=True,id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42,network=Network(ab71171e-f0f5-414d-bcc8-368b914c6c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ae1c41c-7e')
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:6050883f-a120-4d5e-aa32-7ac0ea703e7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuEzhqWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:18:09 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:18:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[992a9bca-1576-4089-9d14-4bd3f7599180]: Unexpected error while running command.
Nov 22 16:18:09 user nova-compute[75734]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 22 16:18:09 user nova-compute[75734]: Exit code: 21
Nov 22 16:18:09 user nova-compute[75734]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 22 16:18:09 user nova-compute[75734]: Stderr: '' {{(pid=86452) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 22 16:18:09 user nova-compute[75734]: Traceback (most recent call last):
Nov 22 16:18:09 user nova-compute[75734]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 22 16:18:09 user nova-compute[75734]:     ret = func(*f_args, **f_kwargs)
Nov 22 16:18:09 user nova-compute[75734]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 22 16:18:09 user nova-compute[75734]:     return func(*args, **kwargs)
Nov 22 16:18:09 user nova-compute[75734]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 22 16:18:09 user nova-compute[75734]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 22 16:18:09 user nova-compute[75734]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 22 16:18:09 user nova-compute[75734]:     return putils.execute(on_execute=on_execute,
Nov 22 16:18:09 user nova-compute[75734]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 22 16:18:09 user nova-compute[75734]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 22 16:18:09 user nova-compute[75734]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 22 16:18:09 user nova-compute[75734]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 22 16:18:09 user nova-compute[75734]: Exit code: 21
Nov 22 16:18:09 user nova-compute[75734]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 22 16:18:09 user nova-compute[75734]: Stderr: ''
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a9bca-1576-4089-9d14-4bd3f7599180]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 22 16:18:09 user nova-compute[75734]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 22 16:18:09 user nova-compute[75734]: Exit code: 21
Nov 22 16:18:09 user nova-compute[75734]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 22 16:18:09 user nova-compute[75734]: Stderr: ''
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 22 16:18:09 user nova-compute[75734]: ERROR os_brick.initiator.connectors.iscsi 
Nov 22 16:18:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75734) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] <== disconnect_volume: return (38ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:18:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Deleting instance files /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3_del
Nov 22 16:18:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Deletion of /opt/stack/data/nova/instances/fc7bf3ae-9441-4fc5-acfd-b0db023065d3_del complete
Nov 22 16:18:09 user nova-compute[75734]: INFO nova.compute.manager [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:18:09 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Took 0.77 seconds to deallocate network for instance.
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-4e35c296-a74f-45c9-b769-f10b6db673cb req-2ea31394-a71a-4140-9ff0-e5216b3fd4bf service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-deleted-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:09 user nova-compute[75734]: INFO nova.compute.manager [req-4e35c296-a74f-45c9-b769-f10b6db673cb req-2ea31394-a71a-4140-9ff0-e5216b3fd4bf service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Neutron deleted interface 0ae1c41c-7eb1-41e3-8289-286d56e8cf42; detaching it from the instance and deleting it from the info cache
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-4e35c296-a74f-45c9-b769-f10b6db673cb req-2ea31394-a71a-4140-9ff0-e5216b3fd4bf service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Instance spawned successfully.
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-4e35c296-a74f-45c9-b769-f10b6db673cb req-2ea31394-a71a-4140-9ff0-e5216b3fd4bf service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Detach interface failed, port_id=0ae1c41c-7eb1-41e3-8289-286d56e8cf42, reason: Instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:18:09 user nova-compute[75734]: WARNING nova.volume.cinder [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Attachment b476327c-1f0a-4a95-8030-669681fb40b3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b476327c-1f0a-4a95-8030-669681fb40b3. (HTTP 404) (Request-ID: req-ea834ad9-c88f-449c-bbfb-f5caeba08cf9)
Nov 22 16:18:09 user nova-compute[75734]: INFO nova.compute.manager [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Took 0.03 seconds to detach 1 volumes for instance.
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-f426d6ae-e95f-4c4b-8cb3-a14f4c28aec4 req-62dd9636-02a0-41a3-9eb7-33b73a7e09c2 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received event network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f426d6ae-e95f-4c4b-8cb3-a14f4c28aec4 req-62dd9636-02a0-41a3-9eb7-33b73a7e09c2 service nova] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f426d6ae-e95f-4c4b-8cb3-a14f4c28aec4 req-62dd9636-02a0-41a3-9eb7-33b73a7e09c2 service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f426d6ae-e95f-4c4b-8cb3-a14f4c28aec4 req-62dd9636-02a0-41a3-9eb7-33b73a7e09c2 service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-f426d6ae-e95f-4c4b-8cb3-a14f4c28aec4 req-62dd9636-02a0-41a3-9eb7-33b73a7e09c2 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] No waiting events found dispatching network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:09 user nova-compute[75734]: WARNING nova.compute.manager [req-f426d6ae-e95f-4c4b-8cb3-a14f4c28aec4 req-62dd9636-02a0-41a3-9eb7-33b73a7e09c2 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received unexpected event network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 for instance with vm_state building and task_state spawning.
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:10 user nova-compute[75734]: INFO nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:18:10 user nova-compute[75734]: INFO nova.compute.manager [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Took 6.11 seconds to build instance.
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cd91a145-b21c-430e-875c-2810b050fec1 tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.219s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Deleted allocations for instance fc7bf3ae-9441-4fc5-acfd-b0db023065d3
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a8558a91-7bb3-41d1-829a-6d5cd6f00b5c tempest-VolumesSnapshotTestJSON-1189754321 tempest-VolumesSnapshotTestJSON-1189754321-project-member] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:10 user nova-compute[75734]: WARNING nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received unexpected event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with vm_state deleted and task_state None.
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:10 user nova-compute[75734]: WARNING nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received unexpected event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with vm_state deleted and task_state None.
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:10 user nova-compute[75734]: WARNING nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received unexpected event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with vm_state deleted and task_state None.
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-unplugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-unplugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:10 user nova-compute[75734]: WARNING nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received unexpected event network-vif-unplugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with vm_state deleted and task_state None.
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Acquiring lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] Lock "fc7bf3ae-9441-4fc5-acfd-b0db023065d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] No waiting events found dispatching network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:10 user nova-compute[75734]: WARNING nova.compute.manager [req-dededff4-6c9f-4f3a-8155-8bea38f65ac6 req-015e44f8-4424-4ecf-8b68-41591ec86105 service nova] [instance: fc7bf3ae-9441-4fc5-acfd-b0db023065d3] Received unexpected event network-vif-plugged-0ae1c41c-7eb1-41e3-8289-286d56e8cf42 for instance with vm_state deleted and task_state None.
Nov 22 16:18:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:13 user nova-compute[75734]: INFO nova.compute.manager [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Unshelving
Nov 22 16:18:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'pci_requests' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'numa_topology' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:18:14 user nova-compute[75734]: INFO nova.compute.claims [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Claim successful on node user
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:14 user nova-compute[75734]: INFO nova.network.neutron [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquired lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing instance network info cache due to event network-changed-2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:18:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] Acquiring lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Releasing lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:18:15 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Creating image(s)
Nov 22 16:18:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'trusted_certs' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] Acquired lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Refreshing network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG nova.objects.base [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<cf6e3423-f1dc-44ca-92df-2260155485e5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "160e1d15e33f7edd56e579ee0f45d77d0803e2e6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "160e1d15e33f7edd56e579ee0f45d77d0803e2e6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG nova.virt.images [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] 60ed148d-aa3b-4c60-b4dd-e55fa57b374e was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.part /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updated VIF entry in instance network info cache for port 2a2737fe-70bc-41f2-b05e-4b74440bc3b1. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1859c1dc-62af-4d11-b790-69cb343995bd req-f356be4d-ea6a-434c-9a04-998b922a2042 service nova] Releasing lock "refresh_cache-cf6e3423-f1dc-44ca-92df-2260155485e5" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.part /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.converted" returned: 0 in 0.850s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "160e1d15e33f7edd56e579ee0f45d77d0803e2e6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.300s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "160e1d15e33f7edd56e579ee0f45d77d0803e2e6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "160e1d15e33f7edd56e579ee0f45d77d0803e2e6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6,backing_fmt=raw /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6,backing_fmt=raw /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk 1073741824" returned: 0 in 0.051s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "160e1d15e33f7edd56e579ee0f45d77d0803e2e6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6 --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'migration_context' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG nova.objects.base [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<cf6e3423-f1dc-44ca-92df-2260155485e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:18:18 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Rebasing disk image.
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.213s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 -F raw /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:18:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 -F raw /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk" returned: 0 in 2.601s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Ensure instance console log exists: /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Start _get_guest_xml network_info=[{"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='52f8c4910a01e9d112beadb235d29a00',container_format='bare',created_at=2023-11-22T16:16:21Z,direct_url=<?>,disk_format='qcow2',id=60ed148d-aa3b-4c60-b4dd-e55fa57b374e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-214828451-shelved',owner='c0470a32bf194b2ca5de3bd71af4409d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T16:16:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:18:21 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:18:21 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='52f8c4910a01e9d112beadb235d29a00',container_format='bare',created_at=2023-11-22T16:16:21Z,direct_url=<?>,disk_format='qcow2',id=60ed148d-aa3b-4c60-b4dd-e55fa57b374e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-214828451-shelved',owner='c0470a32bf194b2ca5de3bd71af4409d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T16:16:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.objects.base [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<cf6e3423-f1dc-44ca-92df-2260155485e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-214828451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-214828451',id=36,image_ref='60ed148d-aa3b-4c60-b4dd-e55fa57b374e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1751822900',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:14:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-x90dzzuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member',shelved_at='2023-11-22T16:16:25.525778',shelved_host='user',shelved_image_id='60ed148d-aa3b-4c60-b4dd-e55fa57b374e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=cf6e3423-f1dc-44ca-92df-2260155485e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'pci_devices' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.objects.base [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Object Instance<cf6e3423-f1dc-44ca-92df-2260155485e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:18:21 user nova-compute[75734]:   <uuid>cf6e3423-f1dc-44ca-92df-2260155485e5</uuid>
Nov 22 16:18:21 user nova-compute[75734]:   <name>instance-00000024</name>
Nov 22 16:18:21 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:18:21 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:18:21 user nova-compute[75734]:   <metadata>
Nov 22 16:18:21 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:18:21 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:18:21 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-214828451</nova:name>
Nov 22 16:18:21 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:18:21</nova:creationTime>
Nov 22 16:18:21 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:18:21 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:18:21 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:18:21 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:18:21 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:18:21 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:18:21 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:18:21 user nova-compute[75734]:       <nova:owner>
Nov 22 16:18:21 user nova-compute[75734]:         <nova:user uuid="4c444f0bec7641458313d99ebcac79e1">tempest-AttachVolumeShelveTestJSON-1751141796-project-member</nova:user>
Nov 22 16:18:21 user nova-compute[75734]:         <nova:project uuid="c0470a32bf194b2ca5de3bd71af4409d">tempest-AttachVolumeShelveTestJSON-1751141796</nova:project>
Nov 22 16:18:21 user nova-compute[75734]:       </nova:owner>
Nov 22 16:18:21 user nova-compute[75734]:       <nova:root type="image" uuid="60ed148d-aa3b-4c60-b4dd-e55fa57b374e"/>
Nov 22 16:18:21 user nova-compute[75734]:       <nova:ports>
Nov 22 16:18:21 user nova-compute[75734]:         <nova:port uuid="2a2737fe-70bc-41f2-b05e-4b74440bc3b1">
Nov 22 16:18:21 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 16:18:21 user nova-compute[75734]:         </nova:port>
Nov 22 16:18:21 user nova-compute[75734]:       </nova:ports>
Nov 22 16:18:21 user nova-compute[75734]:     </nova:instance>
Nov 22 16:18:21 user nova-compute[75734]:   </metadata>
Nov 22 16:18:21 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:18:21 user nova-compute[75734]:     <system>
Nov 22 16:18:21 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:18:21 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:18:21 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:18:21 user nova-compute[75734]:       <entry name="serial">cf6e3423-f1dc-44ca-92df-2260155485e5</entry>
Nov 22 16:18:21 user nova-compute[75734]:       <entry name="uuid">cf6e3423-f1dc-44ca-92df-2260155485e5</entry>
Nov 22 16:18:21 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:18:21 user nova-compute[75734]:     </system>
Nov 22 16:18:21 user nova-compute[75734]:   </sysinfo>
Nov 22 16:18:21 user nova-compute[75734]:   <os>
Nov 22 16:18:21 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:18:21 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:18:21 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:18:21 user nova-compute[75734]:   </os>
Nov 22 16:18:21 user nova-compute[75734]:   <features>
Nov 22 16:18:21 user nova-compute[75734]:     <acpi/>
Nov 22 16:18:21 user nova-compute[75734]:     <apic/>
Nov 22 16:18:21 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:18:21 user nova-compute[75734]:   </features>
Nov 22 16:18:21 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:18:21 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:18:21 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:18:21 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:18:21 user nova-compute[75734]:   </clock>
Nov 22 16:18:21 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:18:21 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:18:21 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:18:21 user nova-compute[75734]:   </cpu>
Nov 22 16:18:21 user nova-compute[75734]:   <devices>
Nov 22 16:18:21 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:18:21 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:18:21 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk"/>
Nov 22 16:18:21 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:18:21 user nova-compute[75734]:     </disk>
Nov 22 16:18:21 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:18:21 user nova-compute[75734]:       <mac address="fa:16:3e:24:a6:6f"/>
Nov 22 16:18:21 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:18:21 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:18:21 user nova-compute[75734]:       <target dev="tap2a2737fe-70"/>
Nov 22 16:18:21 user nova-compute[75734]:     </interface>
Nov 22 16:18:21 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:18:21 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/console.log" append="off"/>
Nov 22 16:18:21 user nova-compute[75734]:     </serial>
Nov 22 16:18:21 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:18:21 user nova-compute[75734]:     <video>
Nov 22 16:18:21 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:18:21 user nova-compute[75734]:     </video>
Nov 22 16:18:21 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:18:21 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:18:21 user nova-compute[75734]:     </rng>
Nov 22 16:18:21 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:18:21 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:18:21 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:18:21 user nova-compute[75734]:     </memballoon>
Nov 22 16:18:21 user nova-compute[75734]:   </devices>
Nov 22 16:18:21 user nova-compute[75734]: </domain>
Nov 22 16:18:21 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-214828451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-214828451',id=36,image_ref='60ed148d-aa3b-4c60-b4dd-e55fa57b374e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1751822900',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:14:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-x90dzzuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member',shelved_at='2023-11-22T16:16:25.525778',shelved_host='user',shelved_image_id='60ed148d-aa3b-4c60-b4dd-e55fa57b374e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=cf6e3423-f1dc-44ca-92df-2260155485e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG os_vif [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '604145b5-5f91-5481-ac66-ed7c35333978', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a2737fe-70, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a2737fe-70, col_values=(('qos', UUID('552866fa-7238-425f-b533-1e39a5e6a26c')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a2737fe-70, col_values=(('external_ids', {'iface-id': '2a2737fe-70bc-41f2-b05e-4b74440bc3b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:a6:6f', 'vm-uuid': 'cf6e3423-f1dc-44ca-92df-2260155485e5'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:21 user nova-compute[75734]: INFO os_vif [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70')
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:18:21 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] No VIF found with MAC fa:16:3e:24:a6:6f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-12bc8358-d645-4891-a6ca-aaa95b3bc63c req-0944de0a-6063-4e2a-a53a-5ab4907bebaa service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12bc8358-d645-4891-a6ca-aaa95b3bc63c req-0944de0a-6063-4e2a-a53a-5ab4907bebaa service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12bc8358-d645-4891-a6ca-aaa95b3bc63c req-0944de0a-6063-4e2a-a53a-5ab4907bebaa service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-12bc8358-d645-4891-a6ca-aaa95b3bc63c req-0944de0a-6063-4e2a-a53a-5ab4907bebaa service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-12bc8358-d645-4891-a6ca-aaa95b3bc63c req-0944de0a-6063-4e2a-a53a-5ab4907bebaa service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:22 user nova-compute[75734]: WARNING nova.compute.manager [req-12bc8358-d645-4891-a6ca-aaa95b3bc63c req-0944de0a-6063-4e2a-a53a-5ab4907bebaa service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received unexpected event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 16:18:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-d88a4d07-70cd-4edb-85cb-1703197d532f req-f60fb6cc-1b98-4047-8844-da1acbc86a37 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d88a4d07-70cd-4edb-85cb-1703197d532f req-f60fb6cc-1b98-4047-8844-da1acbc86a37 service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d88a4d07-70cd-4edb-85cb-1703197d532f req-f60fb6cc-1b98-4047-8844-da1acbc86a37 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d88a4d07-70cd-4edb-85cb-1703197d532f req-f60fb6cc-1b98-4047-8844-da1acbc86a37 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-d88a4d07-70cd-4edb-85cb-1703197d532f req-f60fb6cc-1b98-4047-8844-da1acbc86a37 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:24 user nova-compute[75734]: WARNING nova.compute.manager [req-d88a4d07-70cd-4edb-85cb-1703197d532f req-f60fb6cc-1b98-4047-8844-da1acbc86a37 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received unexpected event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 16:18:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:18:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:18:25 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance spawned successfully.
Nov 22 16:18:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:18:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f8502e7c-85a9-43f4-a08e-ea70cbe69e98 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.540s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:34 user nova-compute[75734]: INFO nova.compute.manager [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Terminating instance
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.compute.manager [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-66e53880-076a-418a-b04e-9293095b46f9 req-c05f4a9d-5c8d-418f-bfb1-8695adc348cb service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-vif-unplugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66e53880-076a-418a-b04e-9293095b46f9 req-c05f4a9d-5c8d-418f-bfb1-8695adc348cb service nova] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66e53880-076a-418a-b04e-9293095b46f9 req-c05f4a9d-5c8d-418f-bfb1-8695adc348cb service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-66e53880-076a-418a-b04e-9293095b46f9 req-c05f4a9d-5c8d-418f-bfb1-8695adc348cb service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-66e53880-076a-418a-b04e-9293095b46f9 req-c05f4a9d-5c8d-418f-bfb1-8695adc348cb service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] No waiting events found dispatching network-vif-unplugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-66e53880-076a-418a-b04e-9293095b46f9 req-c05f4a9d-5c8d-418f-bfb1-8695adc348cb service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-vif-unplugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:18:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Instance destroyed successfully.
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lazy-loading 'resources' on Instance uuid 01cdc407-771b-4793-bbf2-5fce1714da8d {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2058993008',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2058993008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2058993',id=38,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/xjWb5AjnKW18yUVkGARyQfJFT742Q/UYWRZf+VeB7KhZxqdzmYIcooHr7Z7zt3CYX5+HsyGCth0VnJYhjhidtLwy8kY56ecM1mue+KYmUL9OVhVoKkGLeUih07ftfwQ==',key_name='tempest-keypair-1361133888',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de80a3ed83d34275b47766de30c4fe22',ramdisk_id='',reservation_id='r-6mk5g1wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1102009632',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85146896f44c438c8a76a24b1c1b2d20',uuid=01cdc407-771b-4793-bbf2-5fce1714da8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Converting VIF {"id": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "address": "fa:16:3e:a5:f6:64", "network": {"id": "fd72e639-faae-4972-9ab4-ee8abdcf0333", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2053126813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de80a3ed83d34275b47766de30c4fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a5ed43-8e", "ovs_interfaceid": "55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5,network=Network(fd72e639-faae-4972-9ab4-ee8abdcf0333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a5ed43-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG os_vif [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5,network=Network(fd72e639-faae-4972-9ab4-ee8abdcf0333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a5ed43-8e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55a5ed43-8e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8dd4d4e-3e75-43ea-9adc-ed14883ad8b3) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:18:34 user nova-compute[75734]: INFO os_vif [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f6:64,bridge_name='br-int',has_traffic_filtering=True,id=55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5,network=Network(fd72e639-faae-4972-9ab4-ee8abdcf0333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a5ed43-8e')
Nov 22 16:18:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Deleting instance files /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d_del
Nov 22 16:18:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Deletion of /opt/stack/data/nova/instances/01cdc407-771b-4793-bbf2-5fce1714da8d_del complete
Nov 22 16:18:34 user nova-compute[75734]: INFO nova.compute.manager [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 16:18:34 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:18:34 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:18:35 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:18:35 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Took 0.94 seconds to deallocate network for instance.
Nov 22 16:18:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:36 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Deleted allocations for instance 01cdc407-771b-4793-bbf2-5fce1714da8d
Nov 22 16:18:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-01fad1d1-a761-44a7-accf-2ed782624bab tempest-TestServerVolumeAttachScenarioOldVersion-1102009632 tempest-TestServerVolumeAttachScenarioOldVersion-1102009632-project-member] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.155s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-476e65ed-6b0e-4100-9c29-03a3b2fb03f5 req-11be70cc-5a26-4416-98e1-bc8ec684359e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-476e65ed-6b0e-4100-9c29-03a3b2fb03f5 req-11be70cc-5a26-4416-98e1-bc8ec684359e service nova] Acquiring lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-476e65ed-6b0e-4100-9c29-03a3b2fb03f5 req-11be70cc-5a26-4416-98e1-bc8ec684359e service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-476e65ed-6b0e-4100-9c29-03a3b2fb03f5 req-11be70cc-5a26-4416-98e1-bc8ec684359e service nova] Lock "01cdc407-771b-4793-bbf2-5fce1714da8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-476e65ed-6b0e-4100-9c29-03a3b2fb03f5 req-11be70cc-5a26-4416-98e1-bc8ec684359e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] No waiting events found dispatching network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:18:36 user nova-compute[75734]: WARNING nova.compute.manager [req-476e65ed-6b0e-4100-9c29-03a3b2fb03f5 req-11be70cc-5a26-4416-98e1-bc8ec684359e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received unexpected event network-vif-plugged-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 for instance with vm_state deleted and task_state None.
Nov 22 16:18:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-476e65ed-6b0e-4100-9c29-03a3b2fb03f5 req-11be70cc-5a26-4416-98e1-bc8ec684359e service nova] [instance: 01cdc407-771b-4793-bbf2-5fce1714da8d] Received event network-vif-deleted-55a5ed43-8e37-4ad7-bf9b-8f9bb7e8c5c5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:18:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:18:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:18:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:18:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:18:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:18:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:02 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:03 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:19:04 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:19:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.02132797241211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cf6e3423-f1dc-44ca-92df-2260155485e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:19:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:19:07 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 2d3aa4ee-d620-41af-a9bd-42da727a7f7c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:11 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:19:40 user nova-compute[75734]: INFO nova.compute.claims [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Claim successful on node user
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:19:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG nova.policy [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea1ebdad624741d2b4bec382a6fdfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a496d8470274ecc922a0b3e9c28425b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:19:40 user nova-compute[75734]: INFO nova.virt.block_device [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Booting with volume 3ec053d1-b727-4a32-93f4-fbc624c73708 at /dev/vda
Nov 22 16:19:40 user nova-compute[75734]: DEBUG os_brick.utils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[70298dff-2898-4929-82b4-76428135a663]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d590dd-564c-42ee-b847-83ce2b469d2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa58ea6-9ebf-4695-8507-acc2a62c2df5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d44fd-032d-4693-8921-242699383356]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:19:41 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:19:41 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b4be2-eed2-4884-8d7c-27c61b13a7e4]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG os_brick.utils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating existing volume attachment record: 433229c4-50c0-43c9-8134-db94ed7947a3 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Successfully created port: 29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:19:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Successfully updated port: 29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing instance network info cache due to event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance network_info: |[{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:19:42 user nova-compute[75734]: DEBUG nova.network.neutron [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:19:43 user nova-compute[75734]: DEBUG nova.network.neutron [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updated VIF entry in instance network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:19:43 user nova-compute[75734]: DEBUG nova.network.neutron [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:19:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9dda11a9-29c4-42e3-a607-0808f456c8b7 req-e2e6e296-199d-44bf-bf68-903ee64e721f service nova] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:19:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:19:47 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Creating image(s)
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Ensure instance console log exists: /opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Start _get_guest_xml network_info=[{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '433229c4-50c0-43c9-8134-db94ed7947a3', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a8937cb-0013-438b-a44f-6baa1f2de236', 'attached_at': '', 'detached_at': '', 'volume_id': '3ec053d1-b727-4a32-93f4-fbc624c73708', 'serial': '3ec053d1-b727-4a32-93f4-fbc624c73708'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:19:47 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:19:47 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:19:47 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:19:47 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:19:47 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789bc56-490b-4ad2-939f-76621a24cd84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:19:47 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3a694f-c0d1-452b-a8e5-edf926afe74b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708] added
Nov 22 16:19:47 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca41bc2-116b-449d-8f30-fd32fc12b590]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec513f-13bc-40e5-8f07-08ace522591f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzpEgimN {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzpEgimN" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b86547-3e7e-4699-ae6c-06f4e8655e7c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzpEgimN'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[155dae67-a60f-4cfa-bde4-fd31d8113e9e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[826298e3-770f-439b-bb66-8344fd7e7c44]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:19:47 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:19:47 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:19:47 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:19:47 user nova-compute[75734]: 
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3795d-3e93-45e5-b520-3ff68856a446]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]
Nov 22 16:19:47 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.
Nov 22 16:19:47 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d87a0a-ccc4-4938-ac65-f95f2e988b36]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93cf035-26c8-4b50-89b5-e9b49fa783b0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:19:47 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:19:47 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[107b2487-ac1a-4665-bcef-3e8f4bc6a090]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:19:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23430656232356230', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430656232356230', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-337239465',display_name='tempest-TestShelveInstance-server-337239465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-337239465',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvNK+ENdRdoZY0zEhJn5ilPUDUASyTYKJTdbtFFp2y8CgI84xljs7Ecejk5XHm4kd6sEjM7S3xIyUcfjP7R4FPfF0mpaPG2NdZYmbha6fIin/dZT6cFLsuejSetHuF2QQ==',key_name='tempest-TestShelveInstance-1736957193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a496d8470274ecc922a0b3e9c28425b',ramdisk_id='',reservation_id='r-z2sk33x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-886174634',owner_user_name='tempest-TestShelveInstance-886174634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:19:41Z,user_data=None,user_id='ea1ebdad624741d2b4bec382a6fdfa8b',uuid=8a8937cb-0013-438b-a44f-6baa1f2de236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converting VIF {"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:19:48 user nova-compute[75734]:   <uuid>8a8937cb-0013-438b-a44f-6baa1f2de236</uuid>
Nov 22 16:19:48 user nova-compute[75734]:   <name>instance-00000028</name>
Nov 22 16:19:48 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:19:48 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:19:48 user nova-compute[75734]:   <metadata>
Nov 22 16:19:48 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:19:48 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:19:48 user nova-compute[75734]:       <nova:name>tempest-TestShelveInstance-server-337239465</nova:name>
Nov 22 16:19:48 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:19:47</nova:creationTime>
Nov 22 16:19:48 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:19:48 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:19:48 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:19:48 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:19:48 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:19:48 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:19:48 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:19:48 user nova-compute[75734]:       <nova:owner>
Nov 22 16:19:48 user nova-compute[75734]:         <nova:user uuid="ea1ebdad624741d2b4bec382a6fdfa8b">tempest-TestShelveInstance-886174634-project-member</nova:user>
Nov 22 16:19:48 user nova-compute[75734]:         <nova:project uuid="2a496d8470274ecc922a0b3e9c28425b">tempest-TestShelveInstance-886174634</nova:project>
Nov 22 16:19:48 user nova-compute[75734]:       </nova:owner>
Nov 22 16:19:48 user nova-compute[75734]:       <nova:ports>
Nov 22 16:19:48 user nova-compute[75734]:         <nova:port uuid="29e1ebed-3407-4626-ab1f-cfba48b25d0f">
Nov 22 16:19:48 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 16:19:48 user nova-compute[75734]:         </nova:port>
Nov 22 16:19:48 user nova-compute[75734]:       </nova:ports>
Nov 22 16:19:48 user nova-compute[75734]:     </nova:instance>
Nov 22 16:19:48 user nova-compute[75734]:   </metadata>
Nov 22 16:19:48 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:19:48 user nova-compute[75734]:     <system>
Nov 22 16:19:48 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:19:48 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:19:48 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:19:48 user nova-compute[75734]:       <entry name="serial">8a8937cb-0013-438b-a44f-6baa1f2de236</entry>
Nov 22 16:19:48 user nova-compute[75734]:       <entry name="uuid">8a8937cb-0013-438b-a44f-6baa1f2de236</entry>
Nov 22 16:19:48 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:19:48 user nova-compute[75734]:     </system>
Nov 22 16:19:48 user nova-compute[75734]:   </sysinfo>
Nov 22 16:19:48 user nova-compute[75734]:   <os>
Nov 22 16:19:48 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:19:48 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:19:48 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:19:48 user nova-compute[75734]:   </os>
Nov 22 16:19:48 user nova-compute[75734]:   <features>
Nov 22 16:19:48 user nova-compute[75734]:     <acpi/>
Nov 22 16:19:48 user nova-compute[75734]:     <apic/>
Nov 22 16:19:48 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:19:48 user nova-compute[75734]:   </features>
Nov 22 16:19:48 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:19:48 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:19:48 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:19:48 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:19:48 user nova-compute[75734]:   </clock>
Nov 22 16:19:48 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:19:48 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:19:48 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:19:48 user nova-compute[75734]:   </cpu>
Nov 22 16:19:48 user nova-compute[75734]:   <devices>
Nov 22 16:19:48 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:19:48 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:19:48 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:19:48 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:19:48 user nova-compute[75734]:       <serial>3ec053d1-b727-4a32-93f4-fbc624c73708</serial>
Nov 22 16:19:48 user nova-compute[75734]:     </disk>
Nov 22 16:19:48 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:19:48 user nova-compute[75734]:       <mac address="fa:16:3e:61:a5:3c"/>
Nov 22 16:19:48 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:19:48 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:19:48 user nova-compute[75734]:       <target dev="tap29e1ebed-34"/>
Nov 22 16:19:48 user nova-compute[75734]:     </interface>
Nov 22 16:19:48 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:19:48 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236/console.log" append="off"/>
Nov 22 16:19:48 user nova-compute[75734]:     </serial>
Nov 22 16:19:48 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:19:48 user nova-compute[75734]:     <video>
Nov 22 16:19:48 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:19:48 user nova-compute[75734]:     </video>
Nov 22 16:19:48 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:19:48 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:19:48 user nova-compute[75734]:     </rng>
Nov 22 16:19:48 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:19:48 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:19:48 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:19:48 user nova-compute[75734]:     </memballoon>
Nov 22 16:19:48 user nova-compute[75734]:   </devices>
Nov 22 16:19:48 user nova-compute[75734]: </domain>
Nov 22 16:19:48 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-337239465',display_name='tempest-TestShelveInstance-server-337239465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-337239465',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvNK+ENdRdoZY0zEhJn5ilPUDUASyTYKJTdbtFFp2y8CgI84xljs7Ecejk5XHm4kd6sEjM7S3xIyUcfjP7R4FPfF0mpaPG2NdZYmbha6fIin/dZT6cFLsuejSetHuF2QQ==',key_name='tempest-TestShelveInstance-1736957193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a496d8470274ecc922a0b3e9c28425b',ramdisk_id='',reservation_id='r-z2sk33x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-886174634',owner_user_name='tempest-TestShelveInstance-886174634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:19:41Z,user_data=None,user_id='ea1ebdad624741d2b4bec382a6fdfa8b',uuid=8a8937cb-0013-438b-a44f-6baa1f2de236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converting VIF {"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG os_vif [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '588610a5-b08d-59b0-b011-b03c78391e88', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29e1ebed-34, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29e1ebed-34, col_values=(('qos', UUID('d09653ed-ffc8-4231-bb65-091bd4022328')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29e1ebed-34, col_values=(('external_ids', {'iface-id': '29e1ebed-3407-4626-ab1f-cfba48b25d0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:a5:3c', 'vm-uuid': '8a8937cb-0013-438b-a44f-6baa1f2de236'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:48 user nova-compute[75734]: INFO os_vif [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34')
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:19:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] No VIF found with MAC fa:16:3e:61:a5:3c, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:19:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-84c6f929-c923-4790-8134-a1a3d7933106 req-8d659c1e-6ac9-4e9e-9762-ed5ab41b9372 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:19:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84c6f929-c923-4790-8134-a1a3d7933106 req-8d659c1e-6ac9-4e9e-9762-ed5ab41b9372 service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84c6f929-c923-4790-8134-a1a3d7933106 req-8d659c1e-6ac9-4e9e-9762-ed5ab41b9372 service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-84c6f929-c923-4790-8134-a1a3d7933106 req-8d659c1e-6ac9-4e9e-9762-ed5ab41b9372 service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-84c6f929-c923-4790-8134-a1a3d7933106 req-8d659c1e-6ac9-4e9e-9762-ed5ab41b9372 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:19:49 user nova-compute[75734]: WARNING nova.compute.manager [req-84c6f929-c923-4790-8134-a1a3d7933106 req-8d659c1e-6ac9-4e9e-9762-ed5ab41b9372 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received unexpected event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with vm_state building and task_state spawning.
Nov 22 16:19:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:19:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance spawned successfully.
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-eed82b68-2f1f-4828-8e2b-779af231d19f req-86a924c2-1e51-40d1-bcdc-138993b0de93 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eed82b68-2f1f-4828-8e2b-779af231d19f req-86a924c2-1e51-40d1-bcdc-138993b0de93 service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eed82b68-2f1f-4828-8e2b-779af231d19f req-86a924c2-1e51-40d1-bcdc-138993b0de93 service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eed82b68-2f1f-4828-8e2b-779af231d19f req-86a924c2-1e51-40d1-bcdc-138993b0de93 service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-eed82b68-2f1f-4828-8e2b-779af231d19f req-86a924c2-1e51-40d1-bcdc-138993b0de93 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:19:51 user nova-compute[75734]: WARNING nova.compute.manager [req-eed82b68-2f1f-4828-8e2b-779af231d19f req-86a924c2-1e51-40d1-bcdc-138993b0de93 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received unexpected event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with vm_state building and task_state spawning.
Nov 22 16:19:52 user nova-compute[75734]: INFO nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 22 16:19:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:19:52 user nova-compute[75734]: INFO nova.compute.manager [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Took 11.76 seconds to build instance.
Nov 22 16:19:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f65344e7-25a3-432e-9dd0-e639ab8fe05e tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.851s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "92628b05-9074-4796-80c8-d469e85abec6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:19:54 user nova-compute[75734]: INFO nova.compute.claims [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Claim successful on node user
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "923303f1-e4b1-48ca-b218-efa1708045eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:19:54 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:19:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:19:55 user nova-compute[75734]: INFO nova.compute.claims [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Claim successful on node user
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.policy [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aea0c396dc748bb8f8637981676ea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0532683a0b9b4d65b6c24a9fd2c6bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:19:55 user nova-compute[75734]: INFO nova.virt.block_device [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Booting with volume snapshot ffceb0e0-5727-47a7-b3a3-c95dfdae3fa9 at /dev/vda
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:19:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.policy [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13537e19b07644f98c75a15811352411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f32004419348dcbf74b4f71f80fac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:19:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Creating image(s)
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "/opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "/opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "/opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.268s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:55 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Successfully created port: f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk 1073741824" returned: 0 in 0.059s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.199s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Cannot resize image /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Ensure instance console log exists: /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Successfully created port: 13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:19:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Successfully updated port: f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "refresh_cache-92628b05-9074-4796-80c8-d469e85abec6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquired lock "refresh_cache-92628b05-9074-4796-80c8-d469e85abec6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received event network-changed-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Refreshing instance network info cache due to event network-changed-f0720e75-8e10-4b14-acee-22822f56341b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] Acquiring lock "refresh_cache-92628b05-9074-4796-80c8-d469e85abec6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Updating instance_info_cache with network_info: [{"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Releasing lock "refresh_cache-92628b05-9074-4796-80c8-d469e85abec6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Instance network_info: |[{"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] Acquired lock "refresh_cache-92628b05-9074-4796-80c8-d469e85abec6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Refreshing network info cache for port f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Successfully updated port: 13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "refresh_cache-923303f1-e4b1-48ca-b218-efa1708045eb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquired lock "refresh_cache-923303f1-e4b1-48ca-b218-efa1708045eb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:19:57 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.network.neutron [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Updated VIF entry in instance network info cache for port f0720e75-8e10-4b14-acee-22822f56341b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.network.neutron [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Updating instance_info_cache with network_info: [{"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b71938d1-7fc0-41f6-92b1-280d3867c61b req-bf22f467-a006-4696-b146-06503b638e8b service nova] Releasing lock "refresh_cache-92628b05-9074-4796-80c8-d469e85abec6" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Updating instance_info_cache with network_info: [{"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Releasing lock "refresh_cache-923303f1-e4b1-48ca-b218-efa1708045eb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Instance network_info: |[{"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Start _get_guest_xml network_info=[{"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:19:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:19:58 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1983577187',display_name='tempest-ServersNegativeTestJSON-server-1983577187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1983577187',id=42,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f32004419348dcbf74b4f71f80fac7',ramdisk_id='',reservation_id='r-elqk2y32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-652450684',owner_user_name='tempest-ServersNegativeTestJSON-652450684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:19:55Z,user_data=None,user_id='13537e19b07644f98c75a15811352411',uuid=923303f1-e4b1-48ca-b218-efa1708045eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converting VIF {"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:b9:9a,bridge_name='br-int',has_traffic_filtering=True,id=13b90dbd-1ea8-4596-958c-9229fc0ca82b,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b90dbd-1e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lazy-loading 'pci_devices' on Instance uuid 923303f1-e4b1-48ca-b218-efa1708045eb {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:19:58 user nova-compute[75734]:   <uuid>923303f1-e4b1-48ca-b218-efa1708045eb</uuid>
Nov 22 16:19:58 user nova-compute[75734]:   <name>instance-0000002a</name>
Nov 22 16:19:58 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:19:58 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:19:58 user nova-compute[75734]:   <metadata>
Nov 22 16:19:58 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:19:58 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:19:58 user nova-compute[75734]:       <nova:name>tempest-ServersNegativeTestJSON-server-1983577187</nova:name>
Nov 22 16:19:58 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:19:58</nova:creationTime>
Nov 22 16:19:58 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:19:58 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:19:58 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:19:58 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:19:58 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:19:58 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:19:58 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:19:58 user nova-compute[75734]:       <nova:owner>
Nov 22 16:19:58 user nova-compute[75734]:         <nova:user uuid="13537e19b07644f98c75a15811352411">tempest-ServersNegativeTestJSON-652450684-project-member</nova:user>
Nov 22 16:19:58 user nova-compute[75734]:         <nova:project uuid="05f32004419348dcbf74b4f71f80fac7">tempest-ServersNegativeTestJSON-652450684</nova:project>
Nov 22 16:19:58 user nova-compute[75734]:       </nova:owner>
Nov 22 16:19:58 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:19:58 user nova-compute[75734]:       <nova:ports>
Nov 22 16:19:58 user nova-compute[75734]:         <nova:port uuid="13b90dbd-1ea8-4596-958c-9229fc0ca82b">
Nov 22 16:19:58 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 16:19:58 user nova-compute[75734]:         </nova:port>
Nov 22 16:19:58 user nova-compute[75734]:       </nova:ports>
Nov 22 16:19:58 user nova-compute[75734]:     </nova:instance>
Nov 22 16:19:58 user nova-compute[75734]:   </metadata>
Nov 22 16:19:58 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:19:58 user nova-compute[75734]:     <system>
Nov 22 16:19:58 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:19:58 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:19:58 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:19:58 user nova-compute[75734]:       <entry name="serial">923303f1-e4b1-48ca-b218-efa1708045eb</entry>
Nov 22 16:19:58 user nova-compute[75734]:       <entry name="uuid">923303f1-e4b1-48ca-b218-efa1708045eb</entry>
Nov 22 16:19:58 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:19:58 user nova-compute[75734]:     </system>
Nov 22 16:19:58 user nova-compute[75734]:   </sysinfo>
Nov 22 16:19:58 user nova-compute[75734]:   <os>
Nov 22 16:19:58 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:19:58 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:19:58 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:19:58 user nova-compute[75734]:   </os>
Nov 22 16:19:58 user nova-compute[75734]:   <features>
Nov 22 16:19:58 user nova-compute[75734]:     <acpi/>
Nov 22 16:19:58 user nova-compute[75734]:     <apic/>
Nov 22 16:19:58 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:19:58 user nova-compute[75734]:   </features>
Nov 22 16:19:58 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:19:58 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:19:58 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:19:58 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:19:58 user nova-compute[75734]:   </clock>
Nov 22 16:19:58 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:19:58 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:19:58 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:19:58 user nova-compute[75734]:   </cpu>
Nov 22 16:19:58 user nova-compute[75734]:   <devices>
Nov 22 16:19:58 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:19:58 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:19:58 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk"/>
Nov 22 16:19:58 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:19:58 user nova-compute[75734]:     </disk>
Nov 22 16:19:58 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:19:58 user nova-compute[75734]:       <mac address="fa:16:3e:66:b9:9a"/>
Nov 22 16:19:58 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:19:58 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:19:58 user nova-compute[75734]:       <target dev="tap13b90dbd-1e"/>
Nov 22 16:19:58 user nova-compute[75734]:     </interface>
Nov 22 16:19:58 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:19:58 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/console.log" append="off"/>
Nov 22 16:19:58 user nova-compute[75734]:     </serial>
Nov 22 16:19:58 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:19:58 user nova-compute[75734]:     <video>
Nov 22 16:19:58 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:19:58 user nova-compute[75734]:     </video>
Nov 22 16:19:58 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:19:58 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:19:58 user nova-compute[75734]:     </rng>
Nov 22 16:19:58 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:19:58 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:19:58 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:19:58 user nova-compute[75734]:     </memballoon>
Nov 22 16:19:58 user nova-compute[75734]:   </devices>
Nov 22 16:19:58 user nova-compute[75734]: </domain>
Nov 22 16:19:58 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1983577187',display_name='tempest-ServersNegativeTestJSON-server-1983577187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1983577187',id=42,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f32004419348dcbf74b4f71f80fac7',ramdisk_id='',reservation_id='r-elqk2y32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-652450684',owner_user_name='tempest-ServersNegativeTestJSON-652450684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:19:55Z,user_data=None,user_id='13537e19b07644f98c75a15811352411',uuid=923303f1-e4b1-48ca-b218-efa1708045eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converting VIF {"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:b9:9a,bridge_name='br-int',has_traffic_filtering=True,id=13b90dbd-1ea8-4596-958c-9229fc0ca82b,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b90dbd-1e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG os_vif [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b9:9a,bridge_name='br-int',has_traffic_filtering=True,id=13b90dbd-1ea8-4596-958c-9229fc0ca82b,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b90dbd-1e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97f14ab4-5366-54f6-ab2b-585d9f46575b', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b90dbd-1e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13b90dbd-1e, col_values=(('qos', UUID('190fa19f-202a-4866-8f4b-45fd42c24a5a')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13b90dbd-1e, col_values=(('external_ids', {'iface-id': '13b90dbd-1ea8-4596-958c-9229fc0ca82b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:b9:9a', 'vm-uuid': '923303f1-e4b1-48ca-b218-efa1708045eb'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:58 user nova-compute[75734]: INFO os_vif [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b9:9a,bridge_name='br-int',has_traffic_filtering=True,id=13b90dbd-1ea8-4596-958c-9229fc0ca82b,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b90dbd-1e')
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:19:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] No VIF found with MAC fa:16:3e:66:b9:9a, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-changed-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Refreshing instance network info cache due to event network-changed-13b90dbd-1ea8-4596-958c-9229fc0ca82b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] Acquiring lock "refresh_cache-923303f1-e4b1-48ca-b218-efa1708045eb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] Acquired lock "refresh_cache-923303f1-e4b1-48ca-b218-efa1708045eb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG nova.network.neutron [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Refreshing network info cache for port 13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG nova.network.neutron [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Updated VIF entry in instance network info cache for port 13b90dbd-1ea8-4596-958c-9229fc0ca82b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG nova.network.neutron [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Updating instance_info_cache with network_info: [{"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e5f254b3-f52a-4b33-9cb9-217925f07de6 req-6ca6764c-fbbb-4108-a60d-2bf25c414ce8 service nova] Releasing lock "refresh_cache-923303f1-e4b1-48ca-b218-efa1708045eb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:19:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG os_brick.utils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb44219e-a539-4157-ad46-27bbb27be307]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[61143598-8536-4971-b3ad-ad57ea978c52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b1dae-e70a-4af4-b75f-420b7b590fd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fbd778-b5ed-47f7-b96e-36c55d64e342]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:20:00 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:20:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5fb1c-5730-4910-a41e-670490073f46]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG os_brick.utils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:20:00 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Updating existing volume attachment record: 332734fc-6b0a-478a-bda2-a07c582446e9 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:20:01 user nova-compute[75734]: WARNING nova.compute.manager [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received unexpected event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with vm_state building and task_state spawning.
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:20:01 user nova-compute[75734]: WARNING nova.compute.manager [req-7f81559c-6e3d-4dac-8ab5-261af1ac3bb3 req-eeab88c8-c499-461f-bfa0-401e1efff554 service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received unexpected event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with vm_state building and task_state spawning.
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:20:01 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Instance spawned successfully.
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:01 user nova-compute[75734]: INFO nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 22 16:20:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:20:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:01 user nova-compute[75734]: INFO nova.compute.manager [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Took 6.88 seconds to build instance.
Nov 22 16:20:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cfce08c0-bf70-4902-a639-23b6f36eb70b tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "923303f1-e4b1-48ca-b218-efa1708045eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.976s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:04 user nova-compute[75734]: INFO nova.compute.manager [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Terminating instance
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-3a923724-9aed-4618-9fe3-ae8c041960ba req-06cb40e3-2994-4ecb-9196-be652d184532 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-unplugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3a923724-9aed-4618-9fe3-ae8c041960ba req-06cb40e3-2994-4ecb-9196-be652d184532 service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3a923724-9aed-4618-9fe3-ae8c041960ba req-06cb40e3-2994-4ecb-9196-be652d184532 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3a923724-9aed-4618-9fe3-ae8c041960ba req-06cb40e3-2994-4ecb-9196-be652d184532 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-3a923724-9aed-4618-9fe3-ae8c041960ba req-06cb40e3-2994-4ecb-9196-be652d184532 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-unplugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-3a923724-9aed-4618-9fe3-ae8c041960ba req-06cb40e3-2994-4ecb-9196-be652d184532 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-unplugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Instance destroyed successfully.
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lazy-loading 'resources' on Instance uuid cf6e3423-f1dc-44ca-92df-2260155485e5 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-214828451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-214828451',id=36,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlRIlbTs8pi6TX58kK7DfgmNp7Sv050i5Di2/sbU7f9f4Ov7HydeCH8+m0BgG4BmayXiOsTi5gZ4YosZBZLsqf/JYx7DMRm2Vxhu+hPSa5hNODo6a5DsBfqcNV3X+QEjA==',key_name='tempest-keypair-1751822900',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0470a32bf194b2ca5de3bd71af4409d',ramdisk_id='',reservation_id='r-x90dzzuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1751141796',owner_user_name='tempest-AttachVolumeShelveTestJSON-1751141796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:18:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c444f0bec7641458313d99ebcac79e1',uuid=cf6e3423-f1dc-44ca-92df-2260155485e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converting VIF {"id": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "address": "fa:16:3e:24:a6:6f", "network": {"id": "80308a2a-31a5-4ebf-859d-998ee43e8bf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-219946206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0470a32bf194b2ca5de3bd71af4409d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2737fe-70", "ovs_interfaceid": "2a2737fe-70bc-41f2-b05e-4b74440bc3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG os_vif [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a2737fe-70, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=552866fa-7238-425f-b533-1e39a5e6a26c) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:20:04 user nova-compute[75734]: INFO os_vif [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a6:6f,bridge_name='br-int',has_traffic_filtering=True,id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1,network=Network(80308a2a-31a5-4ebf-859d-998ee43e8bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2737fe-70')
Nov 22 16:20:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Deleting instance files /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5_del
Nov 22 16:20:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Deletion of /opt/stack/data/nova/instances/cf6e3423-f1dc-44ca-92df-2260155485e5_del complete
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:05 user nova-compute[75734]: INFO nova.compute.manager [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:05 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid 'cf6e3423-f1dc-44ca-92df-2260155485e5' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid 'cf6e3423-f1dc-44ca-92df-2260155485e5' (instance-00000024)
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:05 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-555a0f54-4670-4a9c-a561-6f69060c7a21 req-9d82694b-9bf0-4efc-a0e8-a7ece4a221e9 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-deleted-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:20:06 user nova-compute[75734]: INFO nova.compute.manager [req-555a0f54-4670-4a9c-a561-6f69060c7a21 req-9d82694b-9bf0-4efc-a0e8-a7ece4a221e9 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Neutron deleted interface 2a2737fe-70bc-41f2-b05e-4b74440bc3b1; detaching it from the instance and deleting it from the info cache
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-555a0f54-4670-4a9c-a561-6f69060c7a21 req-9d82694b-9bf0-4efc-a0e8-a7ece4a221e9 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-08e4aaaf-48c1-4928-873a-7a7cb4a37500 req-57b9253d-dbbf-4ad4-bd92-f0dfcdf901a1 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-08e4aaaf-48c1-4928-873a-7a7cb4a37500 req-57b9253d-dbbf-4ad4-bd92-f0dfcdf901a1 service nova] Acquiring lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-08e4aaaf-48c1-4928-873a-7a7cb4a37500 req-57b9253d-dbbf-4ad4-bd92-f0dfcdf901a1 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-08e4aaaf-48c1-4928-873a-7a7cb4a37500 req-57b9253d-dbbf-4ad4-bd92-f0dfcdf901a1 service nova] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-08e4aaaf-48c1-4928-873a-7a7cb4a37500 req-57b9253d-dbbf-4ad4-bd92-f0dfcdf901a1 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] No waiting events found dispatching network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:20:06 user nova-compute[75734]: WARNING nova.compute.manager [req-08e4aaaf-48c1-4928-873a-7a7cb4a37500 req-57b9253d-dbbf-4ad4-bd92-f0dfcdf901a1 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Received unexpected event network-vif-plugged-2a2737fe-70bc-41f2-b05e-4b74440bc3b1 for instance with vm_state active and task_state deleting.
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:20:06 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:20:06 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=25.015174865722656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:06 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Took 1.59 seconds to deallocate network for instance.
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-555a0f54-4670-4a9c-a561-6f69060c7a21 req-9d82694b-9bf0-4efc-a0e8-a7ece4a221e9 service nova] [instance: cf6e3423-f1dc-44ca-92df-2260155485e5] Detach interface failed, port_id=2a2737fe-70bc-41f2-b05e-4b74440bc3b1, reason: Instance cf6e3423-f1dc-44ca-92df-2260155485e5 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance cf6e3423-f1dc-44ca-92df-2260155485e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 8a8937cb-0013-438b-a44f-6baa1f2de236 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 92628b05-9074-4796-80c8-d469e85abec6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 923303f1-e4b1-48ca-b218-efa1708045eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:20:06 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.371s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:07 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Deleted allocations for instance cf6e3423-f1dc-44ca-92df-2260155485e5
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:20:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Creating image(s)
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Ensure instance console log exists: /opt/stack/data/nova/instances/92628b05-9074-4796-80c8-d469e85abec6/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Start _get_guest_xml network_info=[{"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '332734fc-6b0a-478a-bda2-a07c582446e9', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlkVhxyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92628b05-9074-4796-80c8-d469e85abec6', 'attached_at': '', 'detached_at': '', 'volume_id': 'c314ddc2-bce4-43b1-9d6a-59666be5599d', 'serial': 'c314ddc2-bce4-43b1-9d6a-59666be5599d'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:20:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:20:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlkVhxyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:20:07 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:20:07 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:20:07 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4159a60-35a1-432a-8c0c-1674fc049742 tempest-AttachVolumeShelveTestJSON-1751141796 tempest-AttachVolumeShelveTestJSON-1751141796-project-member] Lock "cf6e3423-f1dc-44ca-92df-2260155485e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.637s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d9dc3-1236-4b2d-b2a2-0abd2a8ad753]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:20:07 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfb16e-e167-4e94-b4df-1f77addaf458]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d] added
Nov 22 16:20:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff5bea7-2aac-464f-b84b-47ac498aeea8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a762c77-5602-4a41-8706-afd150cea626]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlkVhxyQ {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlkVhxyQ" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71871e6-fc59-4f29-a53a-e21187386d39]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IlkVhxyQ'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2610735e-ec79-43c4-a0b9-b7edbcc03629]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e323f17-3503-42bc-9cb9-d57013193458]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:20:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:20:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:20:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0b9476-2d16-4c0e-a15b-ae364ad1198e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260]
Nov 22 16:20:08 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260] successful.
Nov 22 16:20:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4908d18e-0af4-4597-9f20-de40e84ae002]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc89f155-dff4-4105-a7bd-b5b39141b1d0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:20:08 user nova-compute[75734]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)
Nov 22 16:20:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:20:08 user nova-compute[75734]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)
Nov 22 16:20:08 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc90159-3346-4b68-a5ee-39375931159d]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlkVhxyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26131366533356662', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131366533356662', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1244941771',display_name='tempest-TestVolumeBootPattern-server-1244941771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1244941771',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-vd9rj2wq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:19:55Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=92628b05-9074-4796-80c8-d469e85abec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:98,bridge_name='br-int',has_traffic_filtering=True,id=f0720e75-8e10-4b14-acee-22822f56341b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0720e75-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'pci_devices' on Instance uuid 92628b05-9074-4796-80c8-d469e85abec6 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:20:09 user nova-compute[75734]:   <uuid>92628b05-9074-4796-80c8-d469e85abec6</uuid>
Nov 22 16:20:09 user nova-compute[75734]:   <name>instance-00000029</name>
Nov 22 16:20:09 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:20:09 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:20:09 user nova-compute[75734]:   <metadata>
Nov 22 16:20:09 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:20:09 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:20:09 user nova-compute[75734]:       <nova:name>tempest-TestVolumeBootPattern-server-1244941771</nova:name>
Nov 22 16:20:09 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:20:07</nova:creationTime>
Nov 22 16:20:09 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:20:09 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:20:09 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:20:09 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:20:09 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:20:09 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:20:09 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:20:09 user nova-compute[75734]:       <nova:owner>
Nov 22 16:20:09 user nova-compute[75734]:         <nova:user uuid="0aea0c396dc748bb8f8637981676ea72">tempest-TestVolumeBootPattern-318400595-project-member</nova:user>
Nov 22 16:20:09 user nova-compute[75734]:         <nova:project uuid="0532683a0b9b4d65b6c24a9fd2c6bf23">tempest-TestVolumeBootPattern-318400595</nova:project>
Nov 22 16:20:09 user nova-compute[75734]:       </nova:owner>
Nov 22 16:20:09 user nova-compute[75734]:       <nova:ports>
Nov 22 16:20:09 user nova-compute[75734]:         <nova:port uuid="f0720e75-8e10-4b14-acee-22822f56341b">
Nov 22 16:20:09 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 16:20:09 user nova-compute[75734]:         </nova:port>
Nov 22 16:20:09 user nova-compute[75734]:       </nova:ports>
Nov 22 16:20:09 user nova-compute[75734]:     </nova:instance>
Nov 22 16:20:09 user nova-compute[75734]:   </metadata>
Nov 22 16:20:09 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:20:09 user nova-compute[75734]:     <system>
Nov 22 16:20:09 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:20:09 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:20:09 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:20:09 user nova-compute[75734]:       <entry name="serial">92628b05-9074-4796-80c8-d469e85abec6</entry>
Nov 22 16:20:09 user nova-compute[75734]:       <entry name="uuid">92628b05-9074-4796-80c8-d469e85abec6</entry>
Nov 22 16:20:09 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:20:09 user nova-compute[75734]:     </system>
Nov 22 16:20:09 user nova-compute[75734]:   </sysinfo>
Nov 22 16:20:09 user nova-compute[75734]:   <os>
Nov 22 16:20:09 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:20:09 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:20:09 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:20:09 user nova-compute[75734]:   </os>
Nov 22 16:20:09 user nova-compute[75734]:   <features>
Nov 22 16:20:09 user nova-compute[75734]:     <acpi/>
Nov 22 16:20:09 user nova-compute[75734]:     <apic/>
Nov 22 16:20:09 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:20:09 user nova-compute[75734]:   </features>
Nov 22 16:20:09 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:20:09 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:20:09 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:20:09 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:20:09 user nova-compute[75734]:   </clock>
Nov 22 16:20:09 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:20:09 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:20:09 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:20:09 user nova-compute[75734]:   </cpu>
Nov 22 16:20:09 user nova-compute[75734]:   <devices>
Nov 22 16:20:09 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:20:09 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:20:09 user nova-compute[75734]:       <source dev="/dev/sdc"/>
Nov 22 16:20:09 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:20:09 user nova-compute[75734]:       <serial>c314ddc2-bce4-43b1-9d6a-59666be5599d</serial>
Nov 22 16:20:09 user nova-compute[75734]:     </disk>
Nov 22 16:20:09 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:20:09 user nova-compute[75734]:       <mac address="fa:16:3e:02:9d:98"/>
Nov 22 16:20:09 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:20:09 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:20:09 user nova-compute[75734]:       <target dev="tapf0720e75-8e"/>
Nov 22 16:20:09 user nova-compute[75734]:     </interface>
Nov 22 16:20:09 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:20:09 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/92628b05-9074-4796-80c8-d469e85abec6/console.log" append="off"/>
Nov 22 16:20:09 user nova-compute[75734]:     </serial>
Nov 22 16:20:09 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:20:09 user nova-compute[75734]:     <video>
Nov 22 16:20:09 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:20:09 user nova-compute[75734]:     </video>
Nov 22 16:20:09 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:20:09 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:20:09 user nova-compute[75734]:     </rng>
Nov 22 16:20:09 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:20:09 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:20:09 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:20:09 user nova-compute[75734]:     </memballoon>
Nov 22 16:20:09 user nova-compute[75734]:   </devices>
Nov 22 16:20:09 user nova-compute[75734]: </domain>
Nov 22 16:20:09 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1244941771',display_name='tempest-TestVolumeBootPattern-server-1244941771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1244941771',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-vd9rj2wq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:19:55Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=92628b05-9074-4796-80c8-d469e85abec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:98,bridge_name='br-int',has_traffic_filtering=True,id=f0720e75-8e10-4b14-acee-22822f56341b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0720e75-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG os_vif [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:98,bridge_name='br-int',has_traffic_filtering=True,id=f0720e75-8e10-4b14-acee-22822f56341b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0720e75-8e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84683be3-b44a-50a0-a7cc-1f82616579b9', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0720e75-8e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0720e75-8e, col_values=(('qos', UUID('38196a08-7e56-4fe3-a118-0ecd83289b7b')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0720e75-8e, col_values=(('external_ids', {'iface-id': 'f0720e75-8e10-4b14-acee-22822f56341b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:9d:98', 'vm-uuid': '92628b05-9074-4796-80c8-d469e85abec6'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:09 user nova-compute[75734]: INFO os_vif [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:98,bridge_name='br-int',has_traffic_filtering=True,id=f0720e75-8e10-4b14-acee-22822f56341b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0720e75-8e')
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:20:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No VIF found with MAC fa:16:3e:02:9d:98, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-e1a0514a-3e9d-4ad6-bacd-b5cb1af1e524 req-d3551c28-2c32-4156-bd55-4d6395983364 service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received event network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e1a0514a-3e9d-4ad6-bacd-b5cb1af1e524 req-d3551c28-2c32-4156-bd55-4d6395983364 service nova] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e1a0514a-3e9d-4ad6-bacd-b5cb1af1e524 req-d3551c28-2c32-4156-bd55-4d6395983364 service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e1a0514a-3e9d-4ad6-bacd-b5cb1af1e524 req-d3551c28-2c32-4156-bd55-4d6395983364 service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-e1a0514a-3e9d-4ad6-bacd-b5cb1af1e524 req-d3551c28-2c32-4156-bd55-4d6395983364 service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] No waiting events found dispatching network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:20:10 user nova-compute[75734]: WARNING nova.compute.manager [req-e1a0514a-3e9d-4ad6-bacd-b5cb1af1e524 req-d3551c28-2c32-4156-bd55-4d6395983364 service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received unexpected event network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b for instance with vm_state building and task_state spawning.
Nov 22 16:20:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:20:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Instance spawned successfully.
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-8ff60fc9-ad1c-4151-8697-73d03cec81f9 req-896719c4-e079-47a4-a295-0e32cdabd25b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received event network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8ff60fc9-ad1c-4151-8697-73d03cec81f9 req-896719c4-e079-47a4-a295-0e32cdabd25b service nova] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8ff60fc9-ad1c-4151-8697-73d03cec81f9 req-896719c4-e079-47a4-a295-0e32cdabd25b service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8ff60fc9-ad1c-4151-8697-73d03cec81f9 req-896719c4-e079-47a4-a295-0e32cdabd25b service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.compute.manager [req-8ff60fc9-ad1c-4151-8697-73d03cec81f9 req-896719c4-e079-47a4-a295-0e32cdabd25b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] No waiting events found dispatching network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:20:12 user nova-compute[75734]: WARNING nova.compute.manager [req-8ff60fc9-ad1c-4151-8697-73d03cec81f9 req-896719c4-e079-47a4-a295-0e32cdabd25b service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received unexpected event network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b for instance with vm_state building and task_state spawning.
Nov 22 16:20:12 user nova-compute[75734]: INFO nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 22 16:20:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:20:12 user nova-compute[75734]: INFO nova.compute.manager [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Took 18.30 seconds to build instance.
Nov 22 16:20:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7f8bdee1-9dc8-4ec1-957e-becd0919cdaa tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "92628b05-9074-4796-80c8-d469e85abec6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.431s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 2d3aa4ee-d620-41af-a9bd-42da727a7f7c {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 92628b05-9074-4796-80c8-d469e85abec6 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 923303f1-e4b1-48ca-b218-efa1708045eb {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "92628b05-9074-4796-80c8-d469e85abec6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "923303f1-e4b1-48ca-b218-efa1708045eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "923303f1-e4b1-48ca-b218-efa1708045eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "92628b05-9074-4796-80c8-d469e85abec6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:20:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:20:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:20:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:20:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:20:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:20:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:03 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:03 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:21:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:21:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:21:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:21:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:05 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:21:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:21:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:21:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:21:07 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=24.997817993164062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 8a8937cb-0013-438b-a44f-6baa1f2de236 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 92628b05-9074-4796-80c8-d469e85abec6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 923303f1-e4b1-48ca-b218-efa1708045eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:21:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:10 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:10 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:21:10 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:21:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:21:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:21:10 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:21:10 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 2d3aa4ee-d620-41af-a9bd-42da727a7f7c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:21:11 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:21:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:21:11 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:21:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:21:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:21:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:21:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:21:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:21:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:21:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:21:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing instance network info cache due to event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:21:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:21:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:21:32 user nova-compute[75734]: DEBUG nova.network.neutron [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:21:32 user nova-compute[75734]: DEBUG nova.network.neutron [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updated VIF entry in instance network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:21:32 user nova-compute[75734]: DEBUG nova.network.neutron [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:21:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-264ce10a-e8b9-479e-a680-374dd3bfbf5c req-03670670-1abd-4076-88cc-18b75f343a3c service nova] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:34 user nova-compute[75734]: INFO nova.compute.manager [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Shelve offloading
Nov 22 16:21:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-unplugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-unplugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:34 user nova-compute[75734]: WARNING nova.compute.manager [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received unexpected event network-vif-unplugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with vm_state active and task_state shelving.
Nov 22 16:21:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:34 user nova-compute[75734]: WARNING nova.compute.manager [req-8c8d81b5-689a-4519-815e-81bbf551ba16 req-8a519093-82ce-48b5-b63b-5fe2e62a816a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received unexpected event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with vm_state active and task_state shelving.
Nov 22 16:21:34 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance destroyed successfully.
Nov 22 16:21:34 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:21:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:21:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance destroyed successfully.
Nov 22 16:21:35 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'resources' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-337239465',display_name='tempest-TestShelveInstance-server-337239465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-337239465',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvNK+ENdRdoZY0zEhJn5ilPUDUASyTYKJTdbtFFp2y8CgI84xljs7Ecejk5XHm4kd6sEjM7S3xIyUcfjP7R4FPfF0mpaPG2NdZYmbha6fIin/dZT6cFLsuejSetHuF2QQ==',key_name='tempest-TestShelveInstance-1736957193',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a496d8470274ecc922a0b3e9c28425b',ramdisk_id='',reservation_id='r-z2sk33x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-886174634',owner_user_name='tempest-TestShelveInstance-886174634-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:19:52Z,user_data=None,user_id='ea1ebdad624741d2b4bec382a6fdfa8b',uuid=8a8937cb-0013-438b-a44f-6baa1f2de236,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converting VIF {"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG os_vif [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29e1ebed-34, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d09653ed-ffc8-4231-bb65-091bd4022328) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:35 user nova-compute[75734]: INFO os_vif [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34')
Nov 22 16:21:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:21:36 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing instance network info cache due to event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG nova.network.neutron [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6202e85-dfac-44ac-b073-dfec8f293a3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:21:36 user nova-compute[75734]: No targets found.
Nov 22 16:21:36 user nova-compute[75734]: iSNS:
Nov 22 16:21:36 user nova-compute[75734]: No targets found.
Nov 22 16:21:36 user nova-compute[75734]: STATIC:
Nov 22 16:21:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d
Nov 22 16:21:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:21:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:21:36 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708
Nov 22 16:21:36 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:21:36 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:21:36 user nova-compute[75734]: FIRMWARE:
Nov 22 16:21:36 user nova-compute[75734]: No targets found.
Nov 22 16:21:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:21:36 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:21:36 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[758331b0-14d0-4c27-a861-af9ec0b3813e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef2b47c-1a35-495b-ae2a-7e4eeb977500]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:21:36 user nova-compute[75734]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)
Nov 22 16:21:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:21:36 user nova-compute[75734]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)
Nov 22 16:21:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac48cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[852ed51a-0710-4670-b633-01401a2ef7f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c13b83-6784-44e1-888b-63eeac3ffbc7]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf18fb-7bf3-4af1-9999-01561d57f02a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e330e1-0290-405e-9d04-4192cd57f789]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.058s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0547e6-8e92-45c5-ac98-d9f3c422b630]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd003024-09ba-4e8d-8d2b-df1256ec651a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]
Nov 22 16:21:36 user nova-compute[75734]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.
Nov 22 16:21:36 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b5e6c-41fd-4bbb-9c8c-0a9a9f3ca272]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] <== disconnect_volume: return (359ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:21:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Deleting instance files /opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236_del
Nov 22 16:21:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Deletion of /opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236_del complete
Nov 22 16:21:36 user nova-compute[75734]: DEBUG nova.network.neutron [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updated VIF entry in instance network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG nova.network.neutron [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": null, "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap29e1ebed-34", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ab3fa169-1ccf-447c-869c-96a54f680b8d req-a41baab1-3115-413a-941b-6f22cd109da0 service nova] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:21:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:37 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Deleted allocations for instance 8a8937cb-0013-438b-a44f-6baa1f2de236
Nov 22 16:21:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:21:37 user nova-compute[75734]: DEBUG nova.objects.base [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Object Instance<8a8937cb-0013-438b-a44f-6baa1f2de236> lazy-loaded attributes: resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:21:37 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:21:37 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:21:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b02c56ed-6928-4b73-be84-c589bb6ad879 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.685s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "923303f1-e4b1-48ca-b218-efa1708045eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:44 user nova-compute[75734]: INFO nova.compute.manager [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Terminating instance
Nov 22 16:21:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "92628b05-9074-4796-80c8-d469e85abec6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:45 user nova-compute[75734]: INFO nova.compute.manager [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Terminating instance
Nov 22 16:21:45 user nova-compute[75734]: DEBUG nova.compute.manager [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-ff9c733e-bc53-48bf-ba98-9007c2e3eeae req-f79b7a29-a09b-403e-8485-640601089fcc service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-unplugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ff9c733e-bc53-48bf-ba98-9007c2e3eeae req-f79b7a29-a09b-403e-8485-640601089fcc service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ff9c733e-bc53-48bf-ba98-9007c2e3eeae req-f79b7a29-a09b-403e-8485-640601089fcc service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ff9c733e-bc53-48bf-ba98-9007c2e3eeae req-f79b7a29-a09b-403e-8485-640601089fcc service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-ff9c733e-bc53-48bf-ba98-9007c2e3eeae req-f79b7a29-a09b-403e-8485-640601089fcc service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-unplugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG nova.compute.manager [req-ff9c733e-bc53-48bf-ba98-9007c2e3eeae req-f79b7a29-a09b-403e-8485-640601089fcc service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-unplugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Instance destroyed successfully.
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lazy-loading 'resources' on Instance uuid 923303f1-e4b1-48ca-b218-efa1708045eb {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Instance destroyed successfully.
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'resources' on Instance uuid 92628b05-9074-4796-80c8-d469e85abec6 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1983577187',display_name='tempest-ServersNegativeTestJSON-server-1983577187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1983577187',id=42,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f32004419348dcbf74b4f71f80fac7',ramdisk_id='',reservation_id='r-elqk2y32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-652450684',owner_user_name='tempest-ServersNegativeTestJSON-652450684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:20:02Z,user_data=None,user_id='13537e19b07644f98c75a15811352411',uuid=923303f1-e4b1-48ca-b218-efa1708045eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converting VIF {"id": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "address": "fa:16:3e:66:b9:9a", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b90dbd-1e", "ovs_interfaceid": "13b90dbd-1ea8-4596-958c-9229fc0ca82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:b9:9a,bridge_name='br-int',has_traffic_filtering=True,id=13b90dbd-1ea8-4596-958c-9229fc0ca82b,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b90dbd-1e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_vif [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b9:9a,bridge_name='br-int',has_traffic_filtering=True,id=13b90dbd-1ea8-4596-958c-9229fc0ca82b,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b90dbd-1e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1244941771',display_name='tempest-TestVolumeBootPattern-server-1244941771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1244941771',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-vd9rj2wq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:20:13Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=92628b05-9074-4796-80c8-d469e85abec6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "f0720e75-8e10-4b14-acee-22822f56341b", "address": "fa:16:3e:02:9d:98", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0720e75-8e", "ovs_interfaceid": "f0720e75-8e10-4b14-acee-22822f56341b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:98,bridge_name='br-int',has_traffic_filtering=True,id=f0720e75-8e10-4b14-acee-22822f56341b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0720e75-8e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_vif [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:98,bridge_name='br-int',has_traffic_filtering=True,id=f0720e75-8e10-4b14-acee-22822f56341b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0720e75-8e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b90dbd-1e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0720e75-8e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=190fa19f-202a-4866-8f4b-45fd42c24a5a) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38196a08-7e56-4fe3-a118-0ecd83289b7b) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:21:46 user nova-compute[75734]: INFO os_vif [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b9:9a,bridge_name='br-int',has_traffic_filtering=True,id=13b90dbd-1ea8-4596-958c-9229fc0ca82b,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b90dbd-1e')
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Deleting instance files /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb_del
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Deletion of /opt/stack/data/nova/instances/923303f1-e4b1-48ca-b218-efa1708045eb_del complete
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:21:46 user nova-compute[75734]: INFO os_vif [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:98,bridge_name='br-int',has_traffic_filtering=True,id=f0720e75-8e10-4b14-acee-22822f56341b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0720e75-8e')
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlkVhxyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:21:46 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[343bd2cd-d944-4518-aa86-5535bad52df3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:21:46 user nova-compute[75734]: No targets found.
Nov 22 16:21:46 user nova-compute[75734]: iSNS:
Nov 22 16:21:46 user nova-compute[75734]: No targets found.
Nov 22 16:21:46 user nova-compute[75734]: STATIC:
Nov 22 16:21:46 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d
Nov 22 16:21:46 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:21:46 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:21:46 user nova-compute[75734]: FIRMWARE:
Nov 22 16:21:46 user nova-compute[75734]: No targets found.
Nov 22 16:21:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:21:46 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:21:46 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.compute.manager [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31fabd2-80d5-4df0-9bd1-c9c1dce4b2d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafbd225-f71c-4a07-baca-0bdb967c9645]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)
Nov 22 16:21:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d (non-flash)
Nov 22 16:21:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc701870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15fee13-30f0-4745-87c3-e61914c217b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[71652256-c3e9-4b50-b18d-1f85645c20a7]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b91c9b4-2f28-405b-b520-b46c730e3007]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d83d1e-af9e-4a36-8953-87bd8ca09ce5]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2cbc4d-f535-4620-8bc5-0f953543719a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82db3b-1569-4ea3-815b-10f388b4d66f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260]
Nov 22 16:21:46 user nova-compute[75734]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d, portal: 172.16.0.220,3260] successful.
Nov 22 16:21:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314ddc2-bce4-43b1-9d6a-59666be5599d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f9b1d-16ad-4fd0-af27-2ff534ff0aad]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== disconnect_volume: return (327ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Deleting instance files /opt/stack/data/nova/instances/92628b05-9074-4796-80c8-d469e85abec6_del
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Deletion of /opt/stack/data/nova/instances/92628b05-9074-4796-80c8-d469e85abec6_del complete
Nov 22 16:21:46 user nova-compute[75734]: INFO nova.compute.manager [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Took 1.61 seconds to destroy the instance on the hypervisor.
Nov 22 16:21:46 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:21:46 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 92628b05-9074-4796-80c8-d469e85abec6] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:21:47 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Took 0.93 seconds to deallocate network for instance.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:21:47 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Took 0.72 seconds to deallocate network for instance.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:47 user nova-compute[75734]: WARNING nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received unexpected event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with vm_state deleted and task_state None.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received event network-vif-unplugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] No waiting events found dispatching network-vif-unplugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received event network-vif-unplugged-f0720e75-8e10-4b14-acee-22822f56341b for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received event network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Acquiring lock "92628b05-9074-4796-80c8-d469e85abec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "92628b05-9074-4796-80c8-d469e85abec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] No waiting events found dispatching network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:47 user nova-compute[75734]: WARNING nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received unexpected event network-vif-plugged-f0720e75-8e10-4b14-acee-22822f56341b for instance with vm_state active and task_state deleting.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:47 user nova-compute[75734]: WARNING nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received unexpected event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with vm_state deleted and task_state None.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:47 user nova-compute[75734]: WARNING nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received unexpected event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with vm_state deleted and task_state None.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-unplugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-unplugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:47 user nova-compute[75734]: WARNING nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received unexpected event network-vif-unplugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with vm_state deleted and task_state None.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Acquiring lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] Lock "923303f1-e4b1-48ca-b218-efa1708045eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] No waiting events found dispatching network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:21:47 user nova-compute[75734]: WARNING nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received unexpected event network-vif-plugged-13b90dbd-1ea8-4596-958c-9229fc0ca82b for instance with vm_state deleted and task_state None.
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.manager [req-ade15d2c-d1c3-4482-a8f7-086c2d2d9108 req-b897b544-2652-426f-8621-d22304f035dd service nova] [instance: 923303f1-e4b1-48ca-b218-efa1708045eb] Received event network-vif-deleted-13b90dbd-1ea8-4596-958c-9229fc0ca82b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:47 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Deleted allocations for instance 923303f1-e4b1-48ca-b218-efa1708045eb
Nov 22 16:21:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-05407821-428d-478e-a7ef-27a2eb9c456a tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "923303f1-e4b1-48ca-b218-efa1708045eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.695s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:48 user nova-compute[75734]: INFO nova.compute.manager [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Took 0.80 seconds to detach 1 volumes for instance.
Nov 22 16:21:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Deleting volume: c314ddc2-bce4-43b1-9d6a-59666be5599d {{(pid=75734) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 16:21:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:21:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:21:48 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:21:48 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:21:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:48 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Deleted allocations for instance 92628b05-9074-4796-80c8-d469e85abec6
Nov 22 16:21:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-94a7a2c8-4edb-41d6-93f4-0a03fde166ab tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "92628b05-9074-4796-80c8-d469e85abec6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.596s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:21:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-ae0bb8e2-3114-42ee-8836-af32dc0bdcea req-108d345d-a936-487b-ad3b-516ea78b9f08 service nova] [instance: 92628b05-9074-4796-80c8-d469e85abec6] Received event network-vif-deleted-f0720e75-8e10-4b14-acee-22822f56341b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:21:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:21:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:05 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:06 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:22:06 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:22:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.01470947265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:22:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:11 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:11 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:22:11 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 22 16:22:11 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:22:11 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:22:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:22:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:22:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:22:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:22:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:22:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:22:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:22:49 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:22:49 user nova-compute[75734]: INFO nova.compute.claims [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Claim successful on node user
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:22:50 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.policy [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aea0c396dc748bb8f8637981676ea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0532683a0b9b4d65b6c24a9fd2c6bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:22:50 user nova-compute[75734]: INFO nova.virt.block_device [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Booting with volume 436a1852-4da9-4602-ac60-d0669befbcc0 at /dev/vda
Nov 22 16:22:50 user nova-compute[75734]: DEBUG os_brick.utils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[71367450-ac8f-4dfd-901c-99a2ca333af9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c394b-d987-4dc1-907f-e4719e89aa94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ac2c0-3995-4790-9414-9f330ad3900a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[88489bc7-ec05-40a4-bc4f-3b559b724b01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:22:50 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:22:50 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb08dd1f-7563-400f-a077-ea0129d42e5f]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG os_brick.utils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:22:50 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updating existing volume attachment record: 7f583593-72e0-40da-9636-f76357fcbc60 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Successfully created port: 61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Successfully updated port: 61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquired lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-changed-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Refreshing instance network info cache due to event network-changed-61694cfd-e99d-4480-bb0d-a31abbe1028e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] Acquiring lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:22:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updating instance_info_cache with network_info: [{"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:22:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Releasing lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:22:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Instance network_info: |[{"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:22:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] Acquired lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:22:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Refreshing network info cache for port 61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:22:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updated VIF entry in instance network info cache for port 61694cfd-e99d-4480-bb0d-a31abbe1028e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:22:52 user nova-compute[75734]: DEBUG nova.network.neutron [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updating instance_info_cache with network_info: [{"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:22:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6b4dc53b-6967-41dd-85c7-496bde240732 req-2637fbac-27a3-47a6-a930-b85896ee6643 service nova] Releasing lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:22:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Creating image(s)
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Ensure instance console log exists: /opt/stack/data/nova/instances/1b1271da-3354-4c39-bb4f-fa15bee5ca38/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Start _get_guest_xml network_info=[{"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7f583593-72e0-40da-9636-f76357fcbc60', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PskTypYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b1271da-3354-4c39-bb4f-fa15bee5ca38', 'attached_at': '', 'detached_at': '', 'volume_id': '436a1852-4da9-4602-ac60-d0669befbcc0', 'serial': '436a1852-4da9-4602-ac60-d0669befbcc0'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:22:56 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:22:56 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PskTypYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:22:56 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:22:56 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:22:56 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[773de229-a80f-4d51-954a-4d5db917c7ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:22:56 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a8398-5d20-424c-b07a-43a3b760633c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0] added
Nov 22 16:22:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd8fe26-b72d-461a-a2fd-93e94f813dc7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37002e0-d3a4-4034-af78-9a57664bae8e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PskTypYd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PskTypYd" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a5de95-5fe4-48cb-8aed-05e6659ba6fa]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PskTypYd'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[77750e2b-f381-4286-a699-816eaae395d1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a181fd1-0aae-4913-89b9-559b84658585]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:22:56 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:22:56 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:22:56 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:22:56 user nova-compute[75734]: 
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2132cb81-8bf5-45f8-9b30-09ac3d1e6e1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260]
Nov 22 16:22:56 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260] successful.
Nov 22 16:22:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[79500018-0b7e-4acc-aedb-0d9c2cdd3e7f]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd5d0c-f41b-418d-9dde-766aa7c161f8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:22:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:22:56 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1276996f-1053-4fc2-b425-38197279dfe2]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:22:56 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PskTypYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:22:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:22:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23764373437326566', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:22:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764373437326566', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:22:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1083829499',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1083829499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1083829499',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuRoxjQlads6n5MeKzkgI19uZt239awTWhcYYIMn+0VIVkin3oIVUJdX1VllIVu5uMEYpu5q5wjCmoEp76+lF5IKYndyba4CSC5DKfmUwdbGs31Y8cZfCeBajoIkx0cag==',key_name='tempest-keypair-2112096992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-pburdntg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aea0c396dc748bb8f8637981676ea72',uuid=1b1271da-3354-4c39-bb4f-fa15bee5ca38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:22:57 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:22:57 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=61694cfd-e99d-4480-bb0d-a31abbe1028e,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61694cfd-e9') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:22:57 user nova-compute[75734]: DEBUG nova.objects.instance [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b1271da-3354-4c39-bb4f-fa15bee5ca38 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:22:58 user nova-compute[75734]:   <uuid>1b1271da-3354-4c39-bb4f-fa15bee5ca38</uuid>
Nov 22 16:22:58 user nova-compute[75734]:   <name>instance-0000002b</name>
Nov 22 16:22:58 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:22:58 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:22:58 user nova-compute[75734]:   <metadata>
Nov 22 16:22:58 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:22:58 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:22:58 user nova-compute[75734]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1083829499</nova:name>
Nov 22 16:22:58 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:22:56</nova:creationTime>
Nov 22 16:22:58 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:22:58 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:22:58 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:22:58 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:22:58 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:22:58 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:22:58 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:22:58 user nova-compute[75734]:       <nova:owner>
Nov 22 16:22:58 user nova-compute[75734]:         <nova:user uuid="0aea0c396dc748bb8f8637981676ea72">tempest-TestVolumeBootPattern-318400595-project-member</nova:user>
Nov 22 16:22:58 user nova-compute[75734]:         <nova:project uuid="0532683a0b9b4d65b6c24a9fd2c6bf23">tempest-TestVolumeBootPattern-318400595</nova:project>
Nov 22 16:22:58 user nova-compute[75734]:       </nova:owner>
Nov 22 16:22:58 user nova-compute[75734]:       <nova:ports>
Nov 22 16:22:58 user nova-compute[75734]:         <nova:port uuid="61694cfd-e99d-4480-bb0d-a31abbe1028e">
Nov 22 16:22:58 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 16:22:58 user nova-compute[75734]:         </nova:port>
Nov 22 16:22:58 user nova-compute[75734]:       </nova:ports>
Nov 22 16:22:58 user nova-compute[75734]:     </nova:instance>
Nov 22 16:22:58 user nova-compute[75734]:   </metadata>
Nov 22 16:22:58 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:22:58 user nova-compute[75734]:     <system>
Nov 22 16:22:58 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:22:58 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:22:58 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:22:58 user nova-compute[75734]:       <entry name="serial">1b1271da-3354-4c39-bb4f-fa15bee5ca38</entry>
Nov 22 16:22:58 user nova-compute[75734]:       <entry name="uuid">1b1271da-3354-4c39-bb4f-fa15bee5ca38</entry>
Nov 22 16:22:58 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:22:58 user nova-compute[75734]:     </system>
Nov 22 16:22:58 user nova-compute[75734]:   </sysinfo>
Nov 22 16:22:58 user nova-compute[75734]:   <os>
Nov 22 16:22:58 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:22:58 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:22:58 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:22:58 user nova-compute[75734]:   </os>
Nov 22 16:22:58 user nova-compute[75734]:   <features>
Nov 22 16:22:58 user nova-compute[75734]:     <acpi/>
Nov 22 16:22:58 user nova-compute[75734]:     <apic/>
Nov 22 16:22:58 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:22:58 user nova-compute[75734]:   </features>
Nov 22 16:22:58 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:22:58 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:22:58 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:22:58 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:22:58 user nova-compute[75734]:   </clock>
Nov 22 16:22:58 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:22:58 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:22:58 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:22:58 user nova-compute[75734]:   </cpu>
Nov 22 16:22:58 user nova-compute[75734]:   <devices>
Nov 22 16:22:58 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:22:58 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:22:58 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:22:58 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:22:58 user nova-compute[75734]:       <serial>436a1852-4da9-4602-ac60-d0669befbcc0</serial>
Nov 22 16:22:58 user nova-compute[75734]:     </disk>
Nov 22 16:22:58 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:22:58 user nova-compute[75734]:       <mac address="fa:16:3e:67:e7:24"/>
Nov 22 16:22:58 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:22:58 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:22:58 user nova-compute[75734]:       <target dev="tap61694cfd-e9"/>
Nov 22 16:22:58 user nova-compute[75734]:     </interface>
Nov 22 16:22:58 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:22:58 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/1b1271da-3354-4c39-bb4f-fa15bee5ca38/console.log" append="off"/>
Nov 22 16:22:58 user nova-compute[75734]:     </serial>
Nov 22 16:22:58 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:22:58 user nova-compute[75734]:     <video>
Nov 22 16:22:58 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:22:58 user nova-compute[75734]:     </video>
Nov 22 16:22:58 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:22:58 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:22:58 user nova-compute[75734]:     </rng>
Nov 22 16:22:58 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:22:58 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:22:58 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:22:58 user nova-compute[75734]:     </memballoon>
Nov 22 16:22:58 user nova-compute[75734]:   </devices>
Nov 22 16:22:58 user nova-compute[75734]: </domain>
Nov 22 16:22:58 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1083829499',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1083829499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1083829499',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuRoxjQlads6n5MeKzkgI19uZt239awTWhcYYIMn+0VIVkin3oIVUJdX1VllIVu5uMEYpu5q5wjCmoEp76+lF5IKYndyba4CSC5DKfmUwdbGs31Y8cZfCeBajoIkx0cag==',key_name='tempest-keypair-2112096992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-pburdntg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aea0c396dc748bb8f8637981676ea72',uuid=1b1271da-3354-4c39-bb4f-fa15bee5ca38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=61694cfd-e99d-4480-bb0d-a31abbe1028e,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61694cfd-e9') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG os_vif [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=61694cfd-e99d-4480-bb0d-a31abbe1028e,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61694cfd-e9') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b2e242c-a1b7-536c-938c-c407cdfe98b5', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61694cfd-e9, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61694cfd-e9, col_values=(('qos', UUID('77d87e69-eb21-45ca-9f7d-828643e2b186')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61694cfd-e9, col_values=(('external_ids', {'iface-id': '61694cfd-e99d-4480-bb0d-a31abbe1028e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:e7:24', 'vm-uuid': '1b1271da-3354-4c39-bb4f-fa15bee5ca38'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:58 user nova-compute[75734]: INFO os_vif [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=61694cfd-e99d-4480-bb0d-a31abbe1028e,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61694cfd-e9')
Nov 22 16:22:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:22:58 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No VIF found with MAC fa:16:3e:67:e7:24, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e1f2196-3baf-458a-bbaa-771f71743059 req-995498ff-e5f1-4807-b11e-72a5031093a3 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e1f2196-3baf-458a-bbaa-771f71743059 req-995498ff-e5f1-4807-b11e-72a5031093a3 service nova] Acquiring lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e1f2196-3baf-458a-bbaa-771f71743059 req-995498ff-e5f1-4807-b11e-72a5031093a3 service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9e1f2196-3baf-458a-bbaa-771f71743059 req-995498ff-e5f1-4807-b11e-72a5031093a3 service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-9e1f2196-3baf-458a-bbaa-771f71743059 req-995498ff-e5f1-4807-b11e-72a5031093a3 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] No waiting events found dispatching network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:22:59 user nova-compute[75734]: WARNING nova.compute.manager [req-9e1f2196-3baf-458a-bbaa-771f71743059 req-995498ff-e5f1-4807-b11e-72a5031093a3 service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received unexpected event network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e for instance with vm_state building and task_state spawning.
Nov 22 16:22:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:22:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:23:01 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Instance spawned successfully.
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:23:01 user nova-compute[75734]: INFO nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:23:01 user nova-compute[75734]: INFO nova.compute.manager [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Took 11.64 seconds to build instance.
Nov 22 16:23:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-bef64e97-5b1a-46ad-bd11-8f3edfa87efb tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.735s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-4527e598-06fa-468e-be9c-e59531a31169 req-7a1ba2b3-f16b-4b11-b7d4-e263bb11f0ff service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4527e598-06fa-468e-be9c-e59531a31169 req-7a1ba2b3-f16b-4b11-b7d4-e263bb11f0ff service nova] Acquiring lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4527e598-06fa-468e-be9c-e59531a31169 req-7a1ba2b3-f16b-4b11-b7d4-e263bb11f0ff service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4527e598-06fa-468e-be9c-e59531a31169 req-7a1ba2b3-f16b-4b11-b7d4-e263bb11f0ff service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-4527e598-06fa-468e-be9c-e59531a31169 req-7a1ba2b3-f16b-4b11-b7d4-e263bb11f0ff service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] No waiting events found dispatching network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:23:01 user nova-compute[75734]: WARNING nova.compute.manager [req-4527e598-06fa-468e-be9c-e59531a31169 req-7a1ba2b3-f16b-4b11-b7d4-e263bb11f0ff service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received unexpected event network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e for instance with vm_state active and task_state None.
Nov 22 16:23:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:05 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:05 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:23:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:23:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:23:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=25.012603759765625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b1271da-3354-4c39-bb4f-fa15bee5ca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:23:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:12 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:23:13 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 2d3aa4ee-d620-41af-a9bd-42da727a7f7c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:23:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:23:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:23:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:23:17 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:25 user nova-compute[75734]: INFO nova.compute.manager [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Unshelving
Nov 22 16:23:25 user nova-compute[75734]: INFO nova.virt.block_device [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Booting with volume 3ec053d1-b727-4a32-93f4-fbc624c73708 at /dev/vda
Nov 22 16:23:25 user nova-compute[75734]: DEBUG os_brick.utils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:23:25 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[575825a9-a98b-4e42-9af0-8c120c30c5d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e263aaa0-9384-430f-8155-d69f4e518cbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f826fe9f-1183-4d3f-9da5-b1f167adc6a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[687059a2-e396-4880-864e-4be44e901d3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:23:26 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:23:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e578d7a2-42a3-4ad0-8f08-5d5cdfdbc329]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG os_brick.utils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating existing volume attachment record: a74000f1-3a3d-4686-a4fd-c52be5a7f53a {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:23:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:23:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:23:33 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:23:33 user nova-compute[75734]: INFO nova.compute.claims [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Claim successful on node user
Nov 22 16:23:34 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:34 user nova-compute[75734]: INFO nova.network.neutron [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating port 29e1ebed-3407-4626-ab1f-cfba48b25d0f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing instance network info cache due to event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:23:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:23:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Creating image(s)
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Ensure instance console log exists: /opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Start _get_guest_xml network_info=[{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a74000f1-3a3d-4686-a4fd-c52be5a7f53a', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a8937cb-0013-438b-a44f-6baa1f2de236', 'attached_at': '', 'detached_at': '', 'volume_id': '3ec053d1-b727-4a32-93f4-fbc624c73708', 'serial': '3ec053d1-b727-4a32-93f4-fbc624c73708'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.network.neutron [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:23:35 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:23:35 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.objects.instance [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.objects.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Object Instance<8a8937cb-0013-438b-a44f-6baa1f2de236> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:23:35 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:23:35 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:23:35 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9801226-5f88-49a8-be01-b6c135c1c77c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:23:35 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0affe3-ba6f-42a2-85c6-bcc067aee8cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708] added
Nov 22 16:23:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[11efc423-0b42-467d-b244-f368ded5c360]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[390dffeb-e7e8-492d-9b3a-585476092f1e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzpEgimN {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzpEgimN" returned: 0 in 0.028s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc367e1-97ed-42ad-a83c-f8dcd8f1acf7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzpEgimN'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fd3d67-b438-44e7-95c6-c4f102354865]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c3e566-5862-46ec-9a3b-f09f4b8113b8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:23:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:23:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fce9f2-9608-48b2-8f32-d70d1a957322]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]
Nov 22 16:23:35 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.
Nov 22 16:23:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2799520-d694-4200-a0fb-42b125b58580]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c213a-d769-4bf5-89e7-4f53f84a2d37]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:23:35 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:23:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:23:35 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:23:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27a3f75-7b92-444d-9bc6-573804bc1ac1]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.network.neutron [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updated VIF entry in instance network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG nova.network.neutron [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:23:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76f642a1-f2d5-47d4-b970-57aa14249033 req-55ff43a7-16ec-4bcd-a09c-f29ac9d6206d service nova] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23430656232356230', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430656232356230', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-337239465',display_name='tempest-TestShelveInstance-server-337239465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-337239465',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1736957193',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2a496d8470274ecc922a0b3e9c28425b',ramdisk_id='',reservation_id='r-z2sk33x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-886174634',owner_user_name='tempest-TestShelveInstance-886174634-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:23:26Z,user_data=None,user_id='ea1ebdad624741d2b4bec382a6fdfa8b',uuid=8a8937cb-0013-438b-a44f-6baa1f2de236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converting VIF {"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.objects.instance [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.objects.base [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Object Instance<8a8937cb-0013-438b-a44f-6baa1f2de236> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:23:36 user nova-compute[75734]:   <uuid>8a8937cb-0013-438b-a44f-6baa1f2de236</uuid>
Nov 22 16:23:36 user nova-compute[75734]:   <name>instance-00000028</name>
Nov 22 16:23:36 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:23:36 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:23:36 user nova-compute[75734]:   <metadata>
Nov 22 16:23:36 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:23:36 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:23:36 user nova-compute[75734]:       <nova:name>tempest-TestShelveInstance-server-337239465</nova:name>
Nov 22 16:23:36 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:23:35</nova:creationTime>
Nov 22 16:23:36 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:23:36 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:23:36 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:23:36 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:23:36 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:23:36 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:23:36 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:23:36 user nova-compute[75734]:       <nova:owner>
Nov 22 16:23:36 user nova-compute[75734]:         <nova:user uuid="ea1ebdad624741d2b4bec382a6fdfa8b">tempest-TestShelveInstance-886174634-project-member</nova:user>
Nov 22 16:23:36 user nova-compute[75734]:         <nova:project uuid="2a496d8470274ecc922a0b3e9c28425b">tempest-TestShelveInstance-886174634</nova:project>
Nov 22 16:23:36 user nova-compute[75734]:       </nova:owner>
Nov 22 16:23:36 user nova-compute[75734]:       <nova:ports>
Nov 22 16:23:36 user nova-compute[75734]:         <nova:port uuid="29e1ebed-3407-4626-ab1f-cfba48b25d0f">
Nov 22 16:23:36 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 16:23:36 user nova-compute[75734]:         </nova:port>
Nov 22 16:23:36 user nova-compute[75734]:       </nova:ports>
Nov 22 16:23:36 user nova-compute[75734]:     </nova:instance>
Nov 22 16:23:36 user nova-compute[75734]:   </metadata>
Nov 22 16:23:36 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:23:36 user nova-compute[75734]:     <system>
Nov 22 16:23:36 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:23:36 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:23:36 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:23:36 user nova-compute[75734]:       <entry name="serial">8a8937cb-0013-438b-a44f-6baa1f2de236</entry>
Nov 22 16:23:36 user nova-compute[75734]:       <entry name="uuid">8a8937cb-0013-438b-a44f-6baa1f2de236</entry>
Nov 22 16:23:36 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:23:36 user nova-compute[75734]:     </system>
Nov 22 16:23:36 user nova-compute[75734]:   </sysinfo>
Nov 22 16:23:36 user nova-compute[75734]:   <os>
Nov 22 16:23:36 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:23:36 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:23:36 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:23:36 user nova-compute[75734]:   </os>
Nov 22 16:23:36 user nova-compute[75734]:   <features>
Nov 22 16:23:36 user nova-compute[75734]:     <acpi/>
Nov 22 16:23:36 user nova-compute[75734]:     <apic/>
Nov 22 16:23:36 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:23:36 user nova-compute[75734]:   </features>
Nov 22 16:23:36 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:23:36 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:23:36 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:23:36 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:23:36 user nova-compute[75734]:   </clock>
Nov 22 16:23:36 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:23:36 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:23:36 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:23:36 user nova-compute[75734]:   </cpu>
Nov 22 16:23:36 user nova-compute[75734]:   <devices>
Nov 22 16:23:36 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:23:36 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:23:36 user nova-compute[75734]:       <source dev="/dev/sdc"/>
Nov 22 16:23:36 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:23:36 user nova-compute[75734]:       <serial>3ec053d1-b727-4a32-93f4-fbc624c73708</serial>
Nov 22 16:23:36 user nova-compute[75734]:     </disk>
Nov 22 16:23:36 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:23:36 user nova-compute[75734]:       <mac address="fa:16:3e:61:a5:3c"/>
Nov 22 16:23:36 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:23:36 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:23:36 user nova-compute[75734]:       <target dev="tap29e1ebed-34"/>
Nov 22 16:23:36 user nova-compute[75734]:     </interface>
Nov 22 16:23:36 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:23:36 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236/console.log" append="off"/>
Nov 22 16:23:36 user nova-compute[75734]:     </serial>
Nov 22 16:23:36 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:23:36 user nova-compute[75734]:     <video>
Nov 22 16:23:36 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:23:36 user nova-compute[75734]:     </video>
Nov 22 16:23:36 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:23:36 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:23:36 user nova-compute[75734]:     </rng>
Nov 22 16:23:36 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:23:36 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:23:36 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:23:36 user nova-compute[75734]:     </memballoon>
Nov 22 16:23:36 user nova-compute[75734]:   </devices>
Nov 22 16:23:36 user nova-compute[75734]: </domain>
Nov 22 16:23:36 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-337239465',display_name='tempest-TestShelveInstance-server-337239465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-337239465',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1736957193',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2a496d8470274ecc922a0b3e9c28425b',ramdisk_id='',reservation_id='r-z2sk33x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-886174634',owner_user_name='tempest-TestShelveInstance-886174634-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:23:26Z,user_data=None,user_id='ea1ebdad624741d2b4bec382a6fdfa8b',uuid=8a8937cb-0013-438b-a44f-6baa1f2de236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converting VIF {"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG os_vif [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '588610a5-b08d-59b0-b011-b03c78391e88', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29e1ebed-34, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29e1ebed-34, col_values=(('qos', UUID('4272aa5b-bb25-4cb8-bc4b-3f35f8091822')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29e1ebed-34, col_values=(('external_ids', {'iface-id': '29e1ebed-3407-4626-ab1f-cfba48b25d0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:a5:3c', 'vm-uuid': '8a8937cb-0013-438b-a44f-6baa1f2de236'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:36 user nova-compute[75734]: INFO os_vif [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34')
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:23:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] No VIF found with MAC fa:16:3e:61:a5:3c, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-6d1f2b2a-1d44-4582-a0f0-b39b4356b2ef req-d44b9743-7a66-4fc8-8e42-3f550a92395a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d1f2b2a-1d44-4582-a0f0-b39b4356b2ef req-d44b9743-7a66-4fc8-8e42-3f550a92395a service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d1f2b2a-1d44-4582-a0f0-b39b4356b2ef req-d44b9743-7a66-4fc8-8e42-3f550a92395a service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6d1f2b2a-1d44-4582-a0f0-b39b4356b2ef req-d44b9743-7a66-4fc8-8e42-3f550a92395a service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-6d1f2b2a-1d44-4582-a0f0-b39b4356b2ef req-d44b9743-7a66-4fc8-8e42-3f550a92395a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:23:38 user nova-compute[75734]: WARNING nova.compute.manager [req-6d1f2b2a-1d44-4582-a0f0-b39b4356b2ef req-d44b9743-7a66-4fc8-8e42-3f550a92395a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received unexpected event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:23:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance spawned successfully.
Nov 22 16:23:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-321535bc-ed55-4a80-a99b-df17fd4bc748 tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.509s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-63bc1d37-db47-4938-b93e-5f87e3b91ec8 req-3e52a8b3-f677-4bca-a057-459785a64acd service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-63bc1d37-db47-4938-b93e-5f87e3b91ec8 req-3e52a8b3-f677-4bca-a057-459785a64acd service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-63bc1d37-db47-4938-b93e-5f87e3b91ec8 req-3e52a8b3-f677-4bca-a057-459785a64acd service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-63bc1d37-db47-4938-b93e-5f87e3b91ec8 req-3e52a8b3-f677-4bca-a057-459785a64acd service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:23:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-63bc1d37-db47-4938-b93e-5f87e3b91ec8 req-3e52a8b3-f677-4bca-a057-459785a64acd service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:23:40 user nova-compute[75734]: WARNING nova.compute.manager [req-63bc1d37-db47-4938-b93e-5f87e3b91ec8 req-3e52a8b3-f677-4bca-a057-459785a64acd service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received unexpected event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with vm_state active and task_state None.
Nov 22 16:23:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:23:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:23:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:23:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:23:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:23:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:23:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:23:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:23:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:23:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:23:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:23:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:23:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:23:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:24:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:24:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:24:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:24:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.01080322265625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b1271da-3354-4c39-bb4f-fa15bee5ca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 8a8937cb-0013-438b-a44f-6baa1f2de236 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:24:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:10 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:10 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:11 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:24:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:24:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:24:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:24:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updating instance_info_cache with network_info: [{"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:24:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:24:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:24:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:24:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:24:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:24:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:24:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:24:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:24:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:24:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:24:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:24:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:24:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:24:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-changed-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:24:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Refreshing instance network info cache due to event network-changed-61694cfd-e99d-4480-bb0d-a31abbe1028e. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:24:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] Acquiring lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:24:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] Acquired lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:24:40 user nova-compute[75734]: DEBUG nova.network.neutron [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Refreshing network info cache for port 61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG nova.network.neutron [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updated VIF entry in instance network info cache for port 61694cfd-e99d-4480-bb0d-a31abbe1028e. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG nova.network.neutron [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updating instance_info_cache with network_info: [{"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8219f253-48b7-4812-b0c3-8d82215e799a req-47bba4b4-a701-47b4-8e87-8e78cc0da25b service nova] Releasing lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:24:47 user nova-compute[75734]: INFO nova.compute.claims [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Claim successful on node user
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:24:47 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:24:47 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:24:47 user nova-compute[75734]: INFO nova.virt.block_device [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Booting with volume snapshot 1cb3f371-ced2-4f4b-a6a8-5315fc31a276 at /dev/vda
Nov 22 16:24:48 user nova-compute[75734]: DEBUG nova.policy [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aea0c396dc748bb8f8637981676ea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0532683a0b9b4d65b6c24a9fd2c6bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:24:48 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Successfully created port: 1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Successfully updated port: 1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquired lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-changed-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Refreshing instance network info cache due to event network-changed-1d381322-006d-43a8-989e-fe0c72d432ae. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] Acquiring lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Updating instance_info_cache with network_info: [{"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Releasing lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Instance network_info: |[{"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] Acquired lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:24:49 user nova-compute[75734]: DEBUG nova.network.neutron [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Refreshing network info cache for port 1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:24:50 user nova-compute[75734]: DEBUG nova.network.neutron [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Updated VIF entry in instance network info cache for port 1d381322-006d-43a8-989e-fe0c72d432ae. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:24:50 user nova-compute[75734]: DEBUG nova.network.neutron [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Updating instance_info_cache with network_info: [{"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:24:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e3257614-bcda-4e5a-a1d8-7fba136590db req-768720f6-60ba-42c6-9f53-a1b7fd1d6cfe service nova] Releasing lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:24:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG os_brick.utils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad4fc1d-9ee7-4880-950e-a29db99d96e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bbae66-1286-4ed7-a5a3-044178c06696]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.090s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9411a2ae-6c74-47f6-993a-57a0141c081a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce0e10e-231b-409e-bdeb-3ef1e5d432c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:24:53 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:24:53 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58a32f7-45b5-4d6f-a27f-11a854153833]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG os_brick.utils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:24:53 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Updating existing volume attachment record: 66f48a4a-d655-4af0-bc1e-7ed7869104d1 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:24:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:24:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Creating image(s)
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Ensure instance console log exists: /opt/stack/data/nova/instances/0a8c46cb-0dd7-4814-a04b-da916cb1141b/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Start _get_guest_xml network_info=[{"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-22T16:24:42Z,direct_url=<?>,disk_format='qcow2',id=6dd2b078-c453-400b-a09e-d392f6a109ac,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-802518601',owner='0532683a0b9b4d65b6c24a9fd2c6bf23',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-22T16:24:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '66f48a4a-d655-4af0-bc1e-7ed7869104d1', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQSdFgZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a8c46cb-0dd7-4814-a04b-da916cb1141b', 'attached_at': '', 'detached_at': '', 'volume_id': '2c8de802-a28b-49c6-9e26-9c26d72a8d87', 'serial': '2c8de802-a28b-49c6-9e26-9c26d72a8d87'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:24:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:24:59 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-22T16:24:42Z,direct_url=<?>,disk_format='qcow2',id=6dd2b078-c453-400b-a09e-d392f6a109ac,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-802518601',owner='0532683a0b9b4d65b6c24a9fd2c6bf23',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-22T16:24:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQSdFgZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:24:59 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:24:59 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:24:59 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b3d45d-4a48-49bb-96f7-36aaac193036]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:24:59 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[90031627-10ad-4e5f-b886-ea9c45ac7302]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87] added
Nov 22 16:24:59 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a29c8a-7529-4654-881d-6b9d0853dfe7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e02797-66c6-4bb0-a7a9-c743e6d866d9]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQSdFgZY {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQSdFgZY" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b0146-b6d5-4c13-8c13-0decfb7acccf]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oQSdFgZY'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[593d6a87-626c-4626-99d3-ee5a4c58ead1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:24:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a29809a-50ee-486d-b500-5334b8e38a10]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[96594bf3-ea92-4090-b7e0-d96376339b65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260]
Nov 22 16:25:00 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260] successful.
Nov 22 16:25:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cffb825-37f1-480a-a6c8-b51b7e36c5da]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b87c9-102e-458a-aa71-50b01a37d27c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)
Nov 22 16:25:00 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337cb53-4e38-40c4-ac5c-51c315f165e6]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:00 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQSdFgZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23463663864646431', 'path': '/dev/sdd'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463663864646431', 'path': '/dev/sdd'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1501721324',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1501721324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1501721324',id=44,image_ref='6dd2b078-c453-400b-a09e-d392f6a109ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlGvcNVX19OcFYifjvaG9sJLou7FBplNWMRVgDKAxEdUdjiEfoaqptFTuH/HAoZIi7oM2TccdkQXdH+EJQFksY45yzJQc8mQbGRVeCxIzwXRACD2J1a/FkVDIjC5ZOXiQ==',key_name='tempest-keypair-607515170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-0z99okua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-318400595',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aea0c396dc748bb8f8637981676ea72',uuid=0a8c46cb-0dd7-4814-a04b-da916cb1141b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=1d381322-006d-43a8-989e-fe0c72d432ae,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d381322-00') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.objects.instance [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a8c46cb-0dd7-4814-a04b-da916cb1141b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:25:01 user nova-compute[75734]:   <uuid>0a8c46cb-0dd7-4814-a04b-da916cb1141b</uuid>
Nov 22 16:25:01 user nova-compute[75734]:   <name>instance-0000002c</name>
Nov 22 16:25:01 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:25:01 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:25:01 user nova-compute[75734]:   <metadata>
Nov 22 16:25:01 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:25:01 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:25:01 user nova-compute[75734]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1501721324</nova:name>
Nov 22 16:25:01 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:24:59</nova:creationTime>
Nov 22 16:25:01 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:25:01 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:25:01 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:25:01 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:25:01 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:25:01 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:25:01 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:25:01 user nova-compute[75734]:       <nova:owner>
Nov 22 16:25:01 user nova-compute[75734]:         <nova:user uuid="0aea0c396dc748bb8f8637981676ea72">tempest-TestVolumeBootPattern-318400595-project-member</nova:user>
Nov 22 16:25:01 user nova-compute[75734]:         <nova:project uuid="0532683a0b9b4d65b6c24a9fd2c6bf23">tempest-TestVolumeBootPattern-318400595</nova:project>
Nov 22 16:25:01 user nova-compute[75734]:       </nova:owner>
Nov 22 16:25:01 user nova-compute[75734]:       <nova:root type="image" uuid="6dd2b078-c453-400b-a09e-d392f6a109ac"/>
Nov 22 16:25:01 user nova-compute[75734]:       <nova:ports>
Nov 22 16:25:01 user nova-compute[75734]:         <nova:port uuid="1d381322-006d-43a8-989e-fe0c72d432ae">
Nov 22 16:25:01 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:25:01 user nova-compute[75734]:         </nova:port>
Nov 22 16:25:01 user nova-compute[75734]:       </nova:ports>
Nov 22 16:25:01 user nova-compute[75734]:     </nova:instance>
Nov 22 16:25:01 user nova-compute[75734]:   </metadata>
Nov 22 16:25:01 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:25:01 user nova-compute[75734]:     <system>
Nov 22 16:25:01 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:25:01 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:25:01 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:25:01 user nova-compute[75734]:       <entry name="serial">0a8c46cb-0dd7-4814-a04b-da916cb1141b</entry>
Nov 22 16:25:01 user nova-compute[75734]:       <entry name="uuid">0a8c46cb-0dd7-4814-a04b-da916cb1141b</entry>
Nov 22 16:25:01 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:25:01 user nova-compute[75734]:     </system>
Nov 22 16:25:01 user nova-compute[75734]:   </sysinfo>
Nov 22 16:25:01 user nova-compute[75734]:   <os>
Nov 22 16:25:01 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:25:01 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:25:01 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:25:01 user nova-compute[75734]:   </os>
Nov 22 16:25:01 user nova-compute[75734]:   <features>
Nov 22 16:25:01 user nova-compute[75734]:     <acpi/>
Nov 22 16:25:01 user nova-compute[75734]:     <apic/>
Nov 22 16:25:01 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:25:01 user nova-compute[75734]:   </features>
Nov 22 16:25:01 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:25:01 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:25:01 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:25:01 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:25:01 user nova-compute[75734]:   </clock>
Nov 22 16:25:01 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:25:01 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:25:01 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:25:01 user nova-compute[75734]:   </cpu>
Nov 22 16:25:01 user nova-compute[75734]:   <devices>
Nov 22 16:25:01 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:25:01 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:25:01 user nova-compute[75734]:       <source dev="/dev/sdd"/>
Nov 22 16:25:01 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:25:01 user nova-compute[75734]:       <serial>2c8de802-a28b-49c6-9e26-9c26d72a8d87</serial>
Nov 22 16:25:01 user nova-compute[75734]:     </disk>
Nov 22 16:25:01 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:25:01 user nova-compute[75734]:       <mac address="fa:16:3e:2b:a2:37"/>
Nov 22 16:25:01 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:25:01 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:25:01 user nova-compute[75734]:       <target dev="tap1d381322-00"/>
Nov 22 16:25:01 user nova-compute[75734]:     </interface>
Nov 22 16:25:01 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:25:01 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/0a8c46cb-0dd7-4814-a04b-da916cb1141b/console.log" append="off"/>
Nov 22 16:25:01 user nova-compute[75734]:     </serial>
Nov 22 16:25:01 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:25:01 user nova-compute[75734]:     <video>
Nov 22 16:25:01 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:25:01 user nova-compute[75734]:     </video>
Nov 22 16:25:01 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:25:01 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:25:01 user nova-compute[75734]:     </rng>
Nov 22 16:25:01 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:25:01 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:25:01 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:25:01 user nova-compute[75734]:     </memballoon>
Nov 22 16:25:01 user nova-compute[75734]:   </devices>
Nov 22 16:25:01 user nova-compute[75734]: </domain>
Nov 22 16:25:01 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1501721324',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1501721324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1501721324',id=44,image_ref='6dd2b078-c453-400b-a09e-d392f6a109ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlGvcNVX19OcFYifjvaG9sJLou7FBplNWMRVgDKAxEdUdjiEfoaqptFTuH/HAoZIi7oM2TccdkQXdH+EJQFksY45yzJQc8mQbGRVeCxIzwXRACD2J1a/FkVDIjC5ZOXiQ==',key_name='tempest-keypair-607515170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-0z99okua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-318400595',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aea0c396dc748bb8f8637981676ea72',uuid=0a8c46cb-0dd7-4814-a04b-da916cb1141b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=1d381322-006d-43a8-989e-fe0c72d432ae,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d381322-00') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG os_vif [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=1d381322-006d-43a8-989e-fe0c72d432ae,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d381322-00') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee00a0a1-da5c-5846-b9a1-13283e02e3ee', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d381322-00, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d381322-00, col_values=(('qos', UUID('d213c881-1995-42eb-8933-3348afe05773')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d381322-00, col_values=(('external_ids', {'iface-id': '1d381322-006d-43a8-989e-fe0c72d432ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:a2:37', 'vm-uuid': '0a8c46cb-0dd7-4814-a04b-da916cb1141b'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:01 user nova-compute[75734]: INFO os_vif [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=1d381322-006d-43a8-989e-fe0c72d432ae,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d381322-00')
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:25:01 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No VIF found with MAC fa:16:3e:2b:a2:37, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-e27f6979-37ed-44c5-93be-2c5352503f6f req-cefd28ec-14c7-4280-8fa6-f41ca9e061f3 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e27f6979-37ed-44c5-93be-2c5352503f6f req-cefd28ec-14c7-4280-8fa6-f41ca9e061f3 service nova] Acquiring lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e27f6979-37ed-44c5-93be-2c5352503f6f req-cefd28ec-14c7-4280-8fa6-f41ca9e061f3 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-e27f6979-37ed-44c5-93be-2c5352503f6f req-cefd28ec-14c7-4280-8fa6-f41ca9e061f3 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-e27f6979-37ed-44c5-93be-2c5352503f6f req-cefd28ec-14c7-4280-8fa6-f41ca9e061f3 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] No waiting events found dispatching network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:25:02 user nova-compute[75734]: WARNING nova.compute.manager [req-e27f6979-37ed-44c5-93be-2c5352503f6f req-cefd28ec-14c7-4280-8fa6-f41ca9e061f3 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received unexpected event network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae for instance with vm_state building and task_state spawning.
Nov 22 16:25:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:25:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Instance spawned successfully.
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:25:04 user nova-compute[75734]: INFO nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-79fe3aee-a1f7-4016-b574-3dfd91d80906 req-4659c3b3-3483-4298-aef3-7311d1ba4f67 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79fe3aee-a1f7-4016-b574-3dfd91d80906 req-4659c3b3-3483-4298-aef3-7311d1ba4f67 service nova] Acquiring lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79fe3aee-a1f7-4016-b574-3dfd91d80906 req-4659c3b3-3483-4298-aef3-7311d1ba4f67 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-79fe3aee-a1f7-4016-b574-3dfd91d80906 req-4659c3b3-3483-4298-aef3-7311d1ba4f67 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-79fe3aee-a1f7-4016-b574-3dfd91d80906 req-4659c3b3-3483-4298-aef3-7311d1ba4f67 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] No waiting events found dispatching network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:25:04 user nova-compute[75734]: WARNING nova.compute.manager [req-79fe3aee-a1f7-4016-b574-3dfd91d80906 req-4659c3b3-3483-4298-aef3-7311d1ba4f67 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received unexpected event network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae for instance with vm_state building and task_state spawning.
Nov 22 16:25:04 user nova-compute[75734]: INFO nova.compute.manager [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Took 17.45 seconds to build instance.
Nov 22 16:25:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-a52ce191-955d-4330-93a7-89cb92d317c2 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.554s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:25:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:25:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:25:08 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=25.008769989013672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b1271da-3354-4c39-bb4f-fa15bee5ca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 8a8937cb-0013-438b-a44f-6baa1f2de236 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0a8c46cb-0dd7-4814-a04b-da916cb1141b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:25:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:10 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:11 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:12 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:25:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:25:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:25:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:25:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:25:14 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 2d3aa4ee-d620-41af-a9bd-42da727a7f7c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:25:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [{"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:25:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-2d3aa4ee-d620-41af-a9bd-42da727a7f7c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:25:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:25:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing instance network info cache due to event network-changed-29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] Acquiring lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] Acquired lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG nova.network.neutron [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Refreshing network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:16 user nova-compute[75734]: INFO nova.compute.manager [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Terminating instance
Nov 22 16:25:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updated VIF entry in instance network info cache for port 29e1ebed-3407-4626-ab1f-cfba48b25d0f. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [{"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bcbb1867-d4f4-4a10-87a2-c9f8c23ac2ad req-427e6157-c3ad-4f49-a805-ca80438bef4a service nova] Releasing lock "refresh_cache-8a8937cb-0013-438b-a44f-6baa1f2de236" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:25:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Instance destroyed successfully.
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.objects.instance [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lazy-loading 'resources' on Instance uuid 8a8937cb-0013-438b-a44f-6baa1f2de236 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T16:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-337239465',display_name='tempest-TestShelveInstance-server-337239465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-337239465',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvNK+ENdRdoZY0zEhJn5ilPUDUASyTYKJTdbtFFp2y8CgI84xljs7Ecejk5XHm4kd6sEjM7S3xIyUcfjP7R4FPfF0mpaPG2NdZYmbha6fIin/dZT6cFLsuejSetHuF2QQ==',key_name='tempest-TestShelveInstance-1736957193',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a496d8470274ecc922a0b3e9c28425b',ramdisk_id='',reservation_id='r-z2sk33x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-886174634',owner_user_name='tempest-TestShelveInstance-886174634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:23:40Z,user_data=None,user_id='ea1ebdad624741d2b4bec382a6fdfa8b',uuid=8a8937cb-0013-438b-a44f-6baa1f2de236,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converting VIF {"id": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "address": "fa:16:3e:61:a5:3c", "network": {"id": "185e9ecf-bafe-4184-bc1e-4e87ce887df8", "bridge": "br-int", "label": "tempest-TestShelveInstance-996947662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a496d8470274ecc922a0b3e9c28425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e1ebed-34", "ovs_interfaceid": "29e1ebed-3407-4626-ab1f-cfba48b25d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_vif [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29e1ebed-34, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4272aa5b-bb25-4cb8-bc4b-3f35f8091822) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:17 user nova-compute[75734]: INFO os_vif [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a5:3c,bridge_name='br-int',has_traffic_filtering=True,id=29e1ebed-3407-4626-ab1f-cfba48b25d0f,network=Network(185e9ecf-bafe-4184-bc1e-4e87ce887df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e1ebed-34')
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzpEgimN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:25:17 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4d30ec-c37e-414b-9341-5b4716e5c971]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:25:17 user nova-compute[75734]: No targets found.
Nov 22 16:25:17 user nova-compute[75734]: iSNS:
Nov 22 16:25:17 user nova-compute[75734]: No targets found.
Nov 22 16:25:17 user nova-compute[75734]: STATIC:
Nov 22 16:25:17 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87
Nov 22 16:25:17 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:25:17 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:25:17 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0
Nov 22 16:25:17 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:25:17 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:25:17 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708
Nov 22 16:25:17 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:25:17 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:25:17 user nova-compute[75734]: FIRMWARE:
Nov 22 16:25:17 user nova-compute[75734]: No targets found.
Nov 22 16:25:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:25:17 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:25:17 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7161d3d2-caff-4e4e-a4e3-b9c7c36a1fc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be36190-3bb3-415c-b020-2703cbd42bd6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:25:17 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:25:17 user nova-compute[75734]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)
Nov 22 16:25:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:25:17 user nova-compute[75734]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 (non-flash)
Nov 22 16:25:17 user nova-compute[75734]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)
Nov 22 16:25:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7f3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897100f-73f9-4c70-a39a-3f5190ad827a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[77abd1d3-6c42-4781-9bc4-a6251e4979fc]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d10f50-aecd-41de-a86f-f1995376acbf]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f664541-30c6-4426-8420-8b2910664420]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d97c7-6f30-434e-9318-5aca5fb2e1f1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5536e9c6-c180-476f-86db-3377f746410c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260]
Nov 22 16:25:17 user nova-compute[75734]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708, portal: 172.16.0.220,3260] successful.
Nov 22 16:25:17 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec053d1-b727-4a32-93f4-fbc624c73708 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8931aefe-3629-450d-8bb0-b934bbb0f020]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] <== disconnect_volume: return (315ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:25:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:25:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Deleting instance files /opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236_del
Nov 22 16:25:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Deletion of /opt/stack/data/nova/instances/8a8937cb-0013-438b-a44f-6baa1f2de236_del complete
Nov 22 16:25:18 user nova-compute[75734]: INFO nova.compute.manager [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 22 16:25:18 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:25:18 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Took 0.47 seconds to deallocate network for instance.
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-ad6e204e-8fcb-4c79-a066-91b9e36f2cb4 req-9cfecbca-7f51-41bb-85d3-ec2e162b2774 service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-deleted-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-unplugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-unplugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-unplugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] Acquiring lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] No waiting events found dispatching network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:25:18 user nova-compute[75734]: WARNING nova.compute.manager [req-0e2e4e14-578c-42d9-8126-2ebb19e93bc3 req-93884adb-9556-4305-bb94-db09cc03f45e service nova] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Received unexpected event network-vif-plugged-29e1ebed-3407-4626-ab1f-cfba48b25d0f for instance with vm_state active and task_state deleting.
Nov 22 16:25:19 user nova-compute[75734]: INFO nova.compute.manager [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Took 0.78 seconds to detach 1 volumes for instance.
Nov 22 16:25:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] [instance: 8a8937cb-0013-438b-a44f-6baa1f2de236] Deleting volume: 3ec053d1-b727-4a32-93f4-fbc624c73708 {{(pid=75734) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 16:25:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:25:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:25:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:25:19 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:25:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:25:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:19 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Deleted allocations for instance 8a8937cb-0013-438b-a44f-6baa1f2de236
Nov 22 16:25:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-2d89eccb-4ce2-44c4-8821-75d568c8aa7a tempest-TestShelveInstance-886174634 tempest-TestShelveInstance-886174634-project-member] Lock "8a8937cb-0013-438b-a44f-6baa1f2de236" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.941s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:25:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:25:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:25:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:26:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:09 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:26:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:26:10 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:26:10 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.00753402709961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b1271da-3354-4c39-bb4f-fa15bee5ca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 0a8c46cb-0dd7-4814-a04b-da916cb1141b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:26:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:26:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:26:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:26:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:26:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updating instance_info_cache with network_info: [{"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:26:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-1b1271da-3354-4c39-bb4f-fa15bee5ca38" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:26:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:26:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:26:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:26:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:26:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-changed-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Refreshing instance network info cache due to event network-changed-1d381322-006d-43a8-989e-fe0c72d432ae. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] Acquiring lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] Acquired lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Refreshing network info cache for port 1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Updated VIF entry in instance network info cache for port 1d381322-006d-43a8-989e-fe0c72d432ae. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG nova.network.neutron [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Updating instance_info_cache with network_info: [{"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3e6507cc-5e8f-4952-88e6-67531c9a0587 req-d6d63519-9fff-4868-a700-4344ed6bbfcf service nova] Releasing lock "refresh_cache-0a8c46cb-0dd7-4814-a04b-da916cb1141b" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:38 user nova-compute[75734]: INFO nova.compute.manager [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Terminating instance
Nov 22 16:26:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Instance destroyed successfully.
Nov 22 16:26:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'resources' on Instance uuid 0a8c46cb-0dd7-4814-a04b-da916cb1141b {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1501721324',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1501721324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1501721324',id=44,image_ref='6dd2b078-c453-400b-a09e-d392f6a109ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlGvcNVX19OcFYifjvaG9sJLou7FBplNWMRVgDKAxEdUdjiEfoaqptFTuH/HAoZIi7oM2TccdkQXdH+EJQFksY45yzJQc8mQbGRVeCxIzwXRACD2J1a/FkVDIjC5ZOXiQ==',key_name='tempest-keypair-607515170',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:25:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-0z99okua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-318400595',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aea0c396dc748bb8f8637981676ea72',uuid=0a8c46cb-0dd7-4814-a04b-da916cb1141b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "1d381322-006d-43a8-989e-fe0c72d432ae", "address": "fa:16:3e:2b:a2:37", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d381322-00", "ovs_interfaceid": "1d381322-006d-43a8-989e-fe0c72d432ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=1d381322-006d-43a8-989e-fe0c72d432ae,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d381322-00') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_vif [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=1d381322-006d-43a8-989e-fe0c72d432ae,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d381322-00') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d381322-00, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d213c881-1995-42eb-8933-3348afe05773) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:39 user nova-compute[75734]: INFO os_vif [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a2:37,bridge_name='br-int',has_traffic_filtering=True,id=1d381322-006d-43a8-989e-fe0c72d432ae,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d381322-00')
Nov 22 16:26:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQSdFgZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:26:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[723de408-379e-4947-bd12-04ebb39f63c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:26:39 user nova-compute[75734]: No targets found.
Nov 22 16:26:39 user nova-compute[75734]: iSNS:
Nov 22 16:26:39 user nova-compute[75734]: No targets found.
Nov 22 16:26:39 user nova-compute[75734]: STATIC:
Nov 22 16:26:39 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87
Nov 22 16:26:39 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:26:39 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:26:39 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0
Nov 22 16:26:39 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:26:39 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:26:39 user nova-compute[75734]: FIRMWARE:
Nov 22 16:26:39 user nova-compute[75734]: No targets found.
Nov 22 16:26:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:26:39 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:26:39 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa70aa-5bd8-4127-85e5-b9666a383d79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c51ea6e-a166-4681-8f1d-5047228de54b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:26:39 user nova-compute[75734]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)
Nov 22 16:26:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:26:39 user nova-compute[75734]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 (non-flash)
Nov 22 16:26:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac6b3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87'): ({'sdd'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Removing single pathed devices sdd {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8eb22a-6620-4523-957f-86d33e8b1db9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a84dc8-ffe8-432e-9ec0-be3e1c93678e]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flushing IO for device /dev/sdd {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a996a00-9ec7-45ee-aab3-274d18115faa]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[007cac31-38c3-4f8f-bd67-50f10aff25a4]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2beb630-e4e3-4c39-86bc-e9236e595aea]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:26:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a325817-6970-4f17-9d7e-81c2ffea41b3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260]
Nov 22 16:26:40 user nova-compute[75734]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87, portal: 172.16.0.220,3260] successful.
Nov 22 16:26:40 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8de802-a28b-49c6-9e26-9c26d72a8d87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[958db0e1-53df-49c2-99e7-0b69365fcaa2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== disconnect_volume: return (305ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:26:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Deleting instance files /opt/stack/data/nova/instances/0a8c46cb-0dd7-4814-a04b-da916cb1141b_del
Nov 22 16:26:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Deletion of /opt/stack/data/nova/instances/0a8c46cb-0dd7-4814-a04b-da916cb1141b_del complete
Nov 22 16:26:40 user nova-compute[75734]: INFO nova.compute.manager [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-vif-unplugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] Acquiring lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] No waiting events found dispatching network-vif-unplugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-vif-unplugged-1d381322-006d-43a8-989e-fe0c72d432ae for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] Acquiring lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] No waiting events found dispatching network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:26:40 user nova-compute[75734]: WARNING nova.compute.manager [req-4983dcc7-8a52-4d16-8ad5-74395c1957e3 req-74cedbf7-802f-448a-9876-233ae3f631b2 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received unexpected event network-vif-plugged-1d381322-006d-43a8-989e-fe0c72d432ae for instance with vm_state active and task_state deleting.
Nov 22 16:26:41 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:26:41 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Took 0.94 seconds to deallocate network for instance.
Nov 22 16:26:41 user nova-compute[75734]: INFO nova.compute.manager [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Took 0.73 seconds to detach 1 volumes for instance.
Nov 22 16:26:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Deleting volume: 2c8de802-a28b-49c6-9e26-9c26d72a8d87 {{(pid=75734) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 16:26:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:42 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:26:42 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:26:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:42 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Deleted allocations for instance 0a8c46cb-0dd7-4814-a04b-da916cb1141b
Nov 22 16:26:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-29eb377b-776c-4d69-b156-63c2a8bae25d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "0a8c46cb-0dd7-4814-a04b-da916cb1141b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.246s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-784b6ea2-31a8-4eee-938b-1028f3131a3d req-ba2d14ba-387b-4f24-9faf-8e3e5d03afd5 service nova] [instance: 0a8c46cb-0dd7-4814-a04b-da916cb1141b] Received event network-vif-deleted-1d381322-006d-43a8-989e-fe0c72d432ae {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:26:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:48 user nova-compute[75734]: INFO nova.compute.manager [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Terminating instance
Nov 22 16:26:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f8a9d4c-2515-48b5-b111-268e1e9c685a req-6db96e9c-deb0-42aa-846f-55112bc5e8e0 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received event network-vif-unplugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f8a9d4c-2515-48b5-b111-268e1e9c685a req-6db96e9c-deb0-42aa-846f-55112bc5e8e0 service nova] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f8a9d4c-2515-48b5-b111-268e1e9c685a req-6db96e9c-deb0-42aa-846f-55112bc5e8e0 service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7f8a9d4c-2515-48b5-b111-268e1e9c685a req-6db96e9c-deb0-42aa-846f-55112bc5e8e0 service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f8a9d4c-2515-48b5-b111-268e1e9c685a req-6db96e9c-deb0-42aa-846f-55112bc5e8e0 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] No waiting events found dispatching network-vif-unplugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-7f8a9d4c-2515-48b5-b111-268e1e9c685a req-6db96e9c-deb0-42aa-846f-55112bc5e8e0 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received event network-vif-unplugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:26:49 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Instance destroyed successfully.
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.objects.instance [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lazy-loading 'resources' on Instance uuid 2d3aa4ee-d620-41af-a9bd-42da727a7f7c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1681697981',display_name='tempest-ServersNegativeTestJSON-server-1681697981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1681697981',id=39,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f32004419348dcbf74b4f71f80fac7',ramdisk_id='',reservation_id='r-20vmnb26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-652450684',owner_user_name='tempest-ServersNegativeTestJSON-652450684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:18:10Z,user_data=None,user_id='13537e19b07644f98c75a15811352411',uuid=2d3aa4ee-d620-41af-a9bd-42da727a7f7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converting VIF {"id": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "address": "fa:16:3e:85:94:e3", "network": {"id": "a12a9ca0-9d41-44cb-881e-ebe7def62b62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-775776561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f32004419348dcbf74b4f71f80fac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bfb4b3-28", "ovs_interfaceid": "a5bfb4b3-2832-478d-97f4-fea8e9e73a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bfb4b3-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG os_vif [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bfb4b3-28') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5bfb4b3-28, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2679d2ec-0dc9-473f-b7cc-c05197a25e5c) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:26:49 user nova-compute[75734]: INFO os_vif [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17,network=Network(a12a9ca0-9d41-44cb-881e-ebe7def62b62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bfb4b3-28')
Nov 22 16:26:49 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Deleting instance files /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c_del
Nov 22 16:26:49 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Deletion of /opt/stack/data/nova/instances/2d3aa4ee-d620-41af-a9bd-42da727a7f7c_del complete
Nov 22 16:26:49 user nova-compute[75734]: INFO nova.compute.manager [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 22 16:26:49 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:26:49 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Took 0.48 seconds to deallocate network for instance.
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-6429796d-5325-4d58-801a-5e6cc927ae7f req-6c1ec05b-ab52-4b28-99fc-a7f79d3948a6 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received event network-vif-deleted-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:26:49 user nova-compute[75734]: INFO nova.compute.manager [req-6429796d-5325-4d58-801a-5e6cc927ae7f req-6c1ec05b-ab52-4b28-99fc-a7f79d3948a6 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Neutron deleted interface a5bfb4b3-2832-478d-97f4-fea8e9e73a17; detaching it from the instance and deleting it from the info cache
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.network.neutron [req-6429796d-5325-4d58-801a-5e6cc927ae7f req-6c1ec05b-ab52-4b28-99fc-a7f79d3948a6 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-6429796d-5325-4d58-801a-5e6cc927ae7f req-6c1ec05b-ab52-4b28-99fc-a7f79d3948a6 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Detach interface failed, port_id=a5bfb4b3-2832-478d-97f4-fea8e9e73a17, reason: Instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:50 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:26:50 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:26:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:50 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Deleted allocations for instance 2d3aa4ee-d620-41af-a9bd-42da727a7f7c
Nov 22 16:26:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3c34858e-5362-41da-96a7-a91f152f1a1f tempest-ServersNegativeTestJSON-652450684 tempest-ServersNegativeTestJSON-652450684-project-member] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.488s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-d5dc37f6-86fd-449c-8645-995da19ef739 req-fef5b042-f443-4c8b-aa2c-1469e0a803c5 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received event network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:26:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d5dc37f6-86fd-449c-8645-995da19ef739 req-fef5b042-f443-4c8b-aa2c-1469e0a803c5 service nova] Acquiring lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:26:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d5dc37f6-86fd-449c-8645-995da19ef739 req-fef5b042-f443-4c8b-aa2c-1469e0a803c5 service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:26:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d5dc37f6-86fd-449c-8645-995da19ef739 req-fef5b042-f443-4c8b-aa2c-1469e0a803c5 service nova] Lock "2d3aa4ee-d620-41af-a9bd-42da727a7f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:26:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-d5dc37f6-86fd-449c-8645-995da19ef739 req-fef5b042-f443-4c8b-aa2c-1469e0a803c5 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] No waiting events found dispatching network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:26:51 user nova-compute[75734]: WARNING nova.compute.manager [req-d5dc37f6-86fd-449c-8645-995da19ef739 req-fef5b042-f443-4c8b-aa2c-1469e0a803c5 service nova] [instance: 2d3aa4ee-d620-41af-a9bd-42da727a7f7c] Received unexpected event network-vif-plugged-a5bfb4b3-2832-478d-97f4-fea8e9e73a17 for instance with vm_state deleted and task_state None.
Nov 22 16:26:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:26:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4993-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:27:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:27:10 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:27:10 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:27:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.026248931884766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b1271da-3354-4c39-bb4f-fa15bee5ca38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:27:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:11 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:11 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:27:12 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:27:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:27:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:27:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:32 user nova-compute[75734]: INFO nova.compute.manager [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Terminating instance
Nov 22 16:27:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-4ee0f2e2-3ee6-4cdf-8470-e370fc4dfd01 req-0311762f-811c-4be6-a9a0-445f534c86bd service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-vif-unplugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4ee0f2e2-3ee6-4cdf-8470-e370fc4dfd01 req-0311762f-811c-4be6-a9a0-445f534c86bd service nova] Acquiring lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4ee0f2e2-3ee6-4cdf-8470-e370fc4dfd01 req-0311762f-811c-4be6-a9a0-445f534c86bd service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4ee0f2e2-3ee6-4cdf-8470-e370fc4dfd01 req-0311762f-811c-4be6-a9a0-445f534c86bd service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-4ee0f2e2-3ee6-4cdf-8470-e370fc4dfd01 req-0311762f-811c-4be6-a9a0-445f534c86bd service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] No waiting events found dispatching network-vif-unplugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:27:32 user nova-compute[75734]: DEBUG nova.compute.manager [req-4ee0f2e2-3ee6-4cdf-8470-e370fc4dfd01 req-0311762f-811c-4be6-a9a0-445f534c86bd service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-vif-unplugged-61694cfd-e99d-4480-bb0d-a31abbe1028e for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Instance destroyed successfully.
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.objects.instance [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'resources' on Instance uuid 1b1271da-3354-4c39-bb4f-fa15bee5ca38 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1083829499',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1083829499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1083829499',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuRoxjQlads6n5MeKzkgI19uZt239awTWhcYYIMn+0VIVkin3oIVUJdX1VllIVu5uMEYpu5q5wjCmoEp76+lF5IKYndyba4CSC5DKfmUwdbGs31Y8cZfCeBajoIkx0cag==',key_name='tempest-keypair-2112096992',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:23:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-pburdntg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aea0c396dc748bb8f8637981676ea72',uuid=1b1271da-3354-4c39-bb4f-fa15bee5ca38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "address": "fa:16:3e:67:e7:24", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61694cfd-e9", "ovs_interfaceid": "61694cfd-e99d-4480-bb0d-a31abbe1028e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=61694cfd-e99d-4480-bb0d-a31abbe1028e,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61694cfd-e9') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_vif [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=61694cfd-e99d-4480-bb0d-a31abbe1028e,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61694cfd-e9') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61694cfd-e9, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77d87e69-eb21-45ca-9f7d-828643e2b186) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:33 user nova-compute[75734]: INFO os_vif [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=61694cfd-e99d-4480-bb0d-a31abbe1028e,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61694cfd-e9')
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PskTypYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:27:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6598ae5-76c3-45b9-93c9-00b0a367c70e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:27:33 user nova-compute[75734]: No targets found.
Nov 22 16:27:33 user nova-compute[75734]: iSNS:
Nov 22 16:27:33 user nova-compute[75734]: No targets found.
Nov 22 16:27:33 user nova-compute[75734]: STATIC:
Nov 22 16:27:33 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0
Nov 22 16:27:33 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:27:33 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:27:33 user nova-compute[75734]: FIRMWARE:
Nov 22 16:27:33 user nova-compute[75734]: No targets found.
Nov 22 16:27:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:27:33 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:27:33 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f9ded8-8e42-437a-a84a-dea1c17cab83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75c9f29-d1e0-45ba-8e25-93c8c3879a46]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:27:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 (non-flash)
Nov 22 16:27:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac48d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b920565-0ef4-4f94-9c7e-9b139c99c991]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5666b40-d3f2-412b-9a8a-26f3b3778ea6]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a798a3d3-f880-4d10-87f7-15661b968462]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b7c0c-050b-44fd-afe3-299d893223c1]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c3c1a3ad',) {{(pid=86452) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4e1d4e-d2b7-4836-a7e2-d20c48f4a3b7]: (4, None) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbca6ab1-6006-49b2-8153-39dc50f8da56]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e6ba53-a350-4add-ab83-72a00eeca7db]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260]
Nov 22 16:27:33 user nova-compute[75734]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0, portal: 172.16.0.220,3260] successful.
Nov 22 16:27:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:436a1852-4da9-4602-ac60-d0669befbcc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab3b2d0-a8c0-447b-9817-68ad086dbd2b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== disconnect_volume: return (292ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:27:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Deleting instance files /opt/stack/data/nova/instances/1b1271da-3354-4c39-bb4f-fa15bee5ca38_del
Nov 22 16:27:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Deletion of /opt/stack/data/nova/instances/1b1271da-3354-4c39-bb4f-fa15bee5ca38_del complete
Nov 22 16:27:33 user nova-compute[75734]: INFO nova.compute.manager [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 22 16:27:33 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:27:33 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:27:34 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:27:34 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Took 0.87 seconds to deallocate network for instance.
Nov 22 16:27:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-edf3183c-747a-493e-af5b-f0ffba7cc781 req-a21c6dbb-215a-434b-9233-017617850d8f service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-edf3183c-747a-493e-af5b-f0ffba7cc781 req-a21c6dbb-215a-434b-9233-017617850d8f service nova] Acquiring lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-edf3183c-747a-493e-af5b-f0ffba7cc781 req-a21c6dbb-215a-434b-9233-017617850d8f service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-edf3183c-747a-493e-af5b-f0ffba7cc781 req-a21c6dbb-215a-434b-9233-017617850d8f service nova] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-edf3183c-747a-493e-af5b-f0ffba7cc781 req-a21c6dbb-215a-434b-9233-017617850d8f service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] No waiting events found dispatching network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:27:35 user nova-compute[75734]: WARNING nova.compute.manager [req-edf3183c-747a-493e-af5b-f0ffba7cc781 req-a21c6dbb-215a-434b-9233-017617850d8f service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received unexpected event network-vif-plugged-61694cfd-e99d-4480-bb0d-a31abbe1028e for instance with vm_state active and task_state deleting.
Nov 22 16:27:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-edf3183c-747a-493e-af5b-f0ffba7cc781 req-a21c6dbb-215a-434b-9233-017617850d8f service nova] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Received event network-vif-deleted-61694cfd-e99d-4480-bb0d-a31abbe1028e {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:27:35 user nova-compute[75734]: INFO nova.compute.manager [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Took 0.78 seconds to detach 1 volumes for instance.
Nov 22 16:27:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 1b1271da-3354-4c39-bb4f-fa15bee5ca38] Deleting volume: 436a1852-4da9-4602-ac60-d0669befbcc0 {{(pid=75734) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:27:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:35 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Deleted allocations for instance 1b1271da-3354-4c39-bb4f-fa15bee5ca38
Nov 22 16:27:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-80256bd7-a3cf-47bb-a247-6541e5f7ccce tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "1b1271da-3354-4c39-bb4f-fa15bee5ca38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.278s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:27:51 user nova-compute[75734]: INFO nova.compute.claims [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Claim successful on node user
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:27:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.policy [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f7b8124d8ef489496bcb5bab0e28710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d22409cfae24b46923c4e5bc6639fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:27:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Creating image(s)
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk 1073741824" returned: 0 in 0.047s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Successfully created port: 1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Cannot resize image /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Ensure instance console log exists: /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Successfully updated port: 1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-changed-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Refreshing instance network info cache due to event network-changed-1d20b284-9bd0-4029-acd9-5ff0b5f788b7. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:27:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.neutron [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance network_info: |[{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Refreshing network info cache for port 1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Start _get_guest_xml network_info=[{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:27:53 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:27:53 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.objects.instance [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'pci_devices' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:27:53 user nova-compute[75734]:   <uuid>f1ca4c7a-d634-4f34-af24-0e8d23ee3319</uuid>
Nov 22 16:27:53 user nova-compute[75734]:   <name>instance-0000002d</name>
Nov 22 16:27:53 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:27:53 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:27:53 user nova-compute[75734]:   <metadata>
Nov 22 16:27:53 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:27:53 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:27:53 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeTestJSON-server-10626121</nova:name>
Nov 22 16:27:53 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:27:53</nova:creationTime>
Nov 22 16:27:53 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:27:53 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:27:53 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:27:53 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:27:53 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:27:53 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:27:53 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:27:53 user nova-compute[75734]:       <nova:owner>
Nov 22 16:27:53 user nova-compute[75734]:         <nova:user uuid="0f7b8124d8ef489496bcb5bab0e28710">tempest-AttachVolumeTestJSON-146842854-project-member</nova:user>
Nov 22 16:27:53 user nova-compute[75734]:         <nova:project uuid="3d22409cfae24b46923c4e5bc6639fdb">tempest-AttachVolumeTestJSON-146842854</nova:project>
Nov 22 16:27:53 user nova-compute[75734]:       </nova:owner>
Nov 22 16:27:53 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:27:53 user nova-compute[75734]:       <nova:ports>
Nov 22 16:27:53 user nova-compute[75734]:         <nova:port uuid="1d20b284-9bd0-4029-acd9-5ff0b5f788b7">
Nov 22 16:27:53 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:27:53 user nova-compute[75734]:         </nova:port>
Nov 22 16:27:53 user nova-compute[75734]:       </nova:ports>
Nov 22 16:27:53 user nova-compute[75734]:     </nova:instance>
Nov 22 16:27:53 user nova-compute[75734]:   </metadata>
Nov 22 16:27:53 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:27:53 user nova-compute[75734]:     <system>
Nov 22 16:27:53 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:27:53 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:27:53 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:27:53 user nova-compute[75734]:       <entry name="serial">f1ca4c7a-d634-4f34-af24-0e8d23ee3319</entry>
Nov 22 16:27:53 user nova-compute[75734]:       <entry name="uuid">f1ca4c7a-d634-4f34-af24-0e8d23ee3319</entry>
Nov 22 16:27:53 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:27:53 user nova-compute[75734]:     </system>
Nov 22 16:27:53 user nova-compute[75734]:   </sysinfo>
Nov 22 16:27:53 user nova-compute[75734]:   <os>
Nov 22 16:27:53 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:27:53 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:27:53 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:27:53 user nova-compute[75734]:   </os>
Nov 22 16:27:53 user nova-compute[75734]:   <features>
Nov 22 16:27:53 user nova-compute[75734]:     <acpi/>
Nov 22 16:27:53 user nova-compute[75734]:     <apic/>
Nov 22 16:27:53 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:27:53 user nova-compute[75734]:   </features>
Nov 22 16:27:53 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:27:53 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:27:53 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:27:53 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:27:53 user nova-compute[75734]:   </clock>
Nov 22 16:27:53 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:27:53 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:27:53 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:27:53 user nova-compute[75734]:   </cpu>
Nov 22 16:27:53 user nova-compute[75734]:   <devices>
Nov 22 16:27:53 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:27:53 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:27:53 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk"/>
Nov 22 16:27:53 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:27:53 user nova-compute[75734]:     </disk>
Nov 22 16:27:53 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:27:53 user nova-compute[75734]:       <mac address="fa:16:3e:04:2d:65"/>
Nov 22 16:27:53 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:27:53 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:27:53 user nova-compute[75734]:       <target dev="tap1d20b284-9b"/>
Nov 22 16:27:53 user nova-compute[75734]:     </interface>
Nov 22 16:27:53 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:27:53 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/console.log" append="off"/>
Nov 22 16:27:53 user nova-compute[75734]:     </serial>
Nov 22 16:27:53 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:27:53 user nova-compute[75734]:     <video>
Nov 22 16:27:53 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:27:53 user nova-compute[75734]:     </video>
Nov 22 16:27:53 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:27:53 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:27:53 user nova-compute[75734]:     </rng>
Nov 22 16:27:53 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:27:53 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:27:53 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:27:53 user nova-compute[75734]:     </memballoon>
Nov 22 16:27:53 user nova-compute[75734]:   </devices>
Nov 22 16:27:53 user nova-compute[75734]: </domain>
Nov 22 16:27:53 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG os_vif [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60cf23d9-9f4b-5736-88f1-d4aab1552b64', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d20b284-9b, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d20b284-9b, col_values=(('qos', UUID('b54e5a77-6a75-4ffa-932b-11ba9a06eacb')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d20b284-9b, col_values=(('external_ids', {'iface-id': '1d20b284-9bd0-4029-acd9-5ff0b5f788b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:2d:65', 'vm-uuid': 'f1ca4c7a-d634-4f34-af24-0e8d23ee3319'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:53 user nova-compute[75734]: INFO os_vif [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b')
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No VIF found with MAC fa:16:3e:04:2d:65, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated VIF entry in instance network info cache for port 1d20b284-9bd0-4029-acd9-5ff0b5f788b7. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG nova.network.neutron [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:27:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb1b4bfd-341f-4e4e-8c6a-363672e4aa9e req-792813b0-e18f-40ab-94bc-9db664e1baee service nova] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:27:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-05cfa9a9-cf8a-4ccd-8f5a-4c1868c7e427 req-ac901f79-628d-48e5-9621-d9b2cff02cfa service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-05cfa9a9-cf8a-4ccd-8f5a-4c1868c7e427 req-ac901f79-628d-48e5-9621-d9b2cff02cfa service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-05cfa9a9-cf8a-4ccd-8f5a-4c1868c7e427 req-ac901f79-628d-48e5-9621-d9b2cff02cfa service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-05cfa9a9-cf8a-4ccd-8f5a-4c1868c7e427 req-ac901f79-628d-48e5-9621-d9b2cff02cfa service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-05cfa9a9-cf8a-4ccd-8f5a-4c1868c7e427 req-ac901f79-628d-48e5-9621-d9b2cff02cfa service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:27:55 user nova-compute[75734]: WARNING nova.compute.manager [req-05cfa9a9-cf8a-4ccd-8f5a-4c1868c7e427 req-ac901f79-628d-48e5-9621-d9b2cff02cfa service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state building and task_state spawning.
Nov 22 16:27:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:27:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance spawned successfully.
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:27:56 user nova-compute[75734]: INFO nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 22 16:27:56 user nova-compute[75734]: DEBUG nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:27:56 user nova-compute[75734]: INFO nova.compute.manager [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Took 5.81 seconds to build instance.
Nov 22 16:27:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-cb2ba702-0458-419f-abca-851270f2b1d5 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.916s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-175a0d63-1201-4a20-844d-0e6d545c738e req-71f2abdd-b205-4f74-a1be-4c8d1e1d5872 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:27:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-175a0d63-1201-4a20-844d-0e6d545c738e req-71f2abdd-b205-4f74-a1be-4c8d1e1d5872 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:27:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-175a0d63-1201-4a20-844d-0e6d545c738e req-71f2abdd-b205-4f74-a1be-4c8d1e1d5872 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:27:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-175a0d63-1201-4a20-844d-0e6d545c738e req-71f2abdd-b205-4f74-a1be-4c8d1e1d5872 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:27:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-175a0d63-1201-4a20-844d-0e6d545c738e req-71f2abdd-b205-4f74-a1be-4c8d1e1d5872 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:27:57 user nova-compute[75734]: WARNING nova.compute.manager [req-175a0d63-1201-4a20-844d-0e6d545c738e req-71f2abdd-b205-4f74-a1be-4c8d1e1d5872 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state active and task_state None.
Nov 22 16:27:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:27:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:10 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:28:10 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:28:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.023578643798828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:28:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:28:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:28:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:28:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:28:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:28:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:28:16 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:28:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:28:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:28:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:28:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "5f6fb556-084d-433d-8546-4271f294cb27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:28:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:28:32 user nova-compute[75734]: INFO nova.compute.claims [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Claim successful on node user
Nov 22 16:28:32 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:28:32 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:28:33 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:28:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:28:33 user nova-compute[75734]: INFO nova.virt.block_device [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Booting with volume af3928b7-cb19-4c30-ab14-2215346c9950 at /dev/vda
Nov 22 16:28:33 user nova-compute[75734]: DEBUG nova.policy [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aea0c396dc748bb8f8637981676ea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0532683a0b9b4d65b6c24a9fd2c6bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d646f15-25c0-4236-900e-b066c7beba3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7459f2a-67a7-4541-b901-5bc00b89172e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4595df-d3ca-49d9-9b4e-5753cc268a13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c503d1-9bcc-441d-a903-e22e0426b713]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:28:33 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:28:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a183df-b101-45c0-a90e-9600d638006f]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG os_brick.utils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updating existing volume attachment record: 6500c28a-5c99-470c-86ec-2071dc05f192 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:33 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Successfully created port: 7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Successfully updated port: 7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquired lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-changed-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG nova.compute.manager [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Refreshing instance network info cache due to event network-changed-7084d13b-7e67-4d98-87ab-fe6a9295d493. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] Acquiring lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:28:34 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updating instance_info_cache with network_info: [{"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Releasing lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Instance network_info: |[{"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] Acquired lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.network.neutron [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Refreshing network info cache for port 7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.network.neutron [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updated VIF entry in instance network info cache for port 7084d13b-7e67-4d98-87ab-fe6a9295d493. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.network.neutron [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updating instance_info_cache with network_info: [{"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eb7cfcf1-3a50-4a35-a959-91355011e93b req-03e96425-9d3f-4619-b1d6-6c61a547c54f service nova] Releasing lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Verify base images {{(pid=75734) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75734) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Image id 9f27db0a-f3d9-4491-93dc-75dd864eab9b yields fingerprint 9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 {{(pid=75734) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 22 16:28:35 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] image 9f27db0a-f3d9-4491-93dc-75dd864eab9b at (/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544): checking
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] image 9f27db0a-f3d9-4491-93dc-75dd864eab9b at (/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544): image is in use {{(pid=75734) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] f1ca4c7a-d634-4f34-af24-0e8d23ee3319 is a valid instance name {{(pid=75734) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] f1ca4c7a-d634-4f34-af24-0e8d23ee3319 has a disk file {{(pid=75734) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 22 16:28:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.450s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 is backed by 9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 {{(pid=75734) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 22 16:28:36 user nova-compute[75734]: WARNING nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Unknown base file: /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac
Nov 22 16:28:36 user nova-compute[75734]: WARNING nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1
Nov 22 16:28:36 user nova-compute[75734]: WARNING nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75
Nov 22 16:28:36 user nova-compute[75734]: WARNING nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Unknown base file: /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6
Nov 22 16:28:36 user nova-compute[75734]: WARNING nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda
Nov 22 16:28:36 user nova-compute[75734]: WARNING nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Unknown base file: /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656
Nov 22 16:28:36 user nova-compute[75734]: WARNING nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Active base files: /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Removable base files: /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1 /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75 /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6 /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656 /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/05fdb74f8165e5abf3fa833965cd3af4ce00baac
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2f75cce48d63c62a4280a5e5d921fd477b13b4a1
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf5d9b3bf83440840287bb02688bcfa869106c75
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/160e1d15e33f7edd56e579ee0f45d77d0803e2e6
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4db6f9a3e13442f3c9fc3b02f17001030781dcda
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/62190d142a58c6ef50ee26a7d8f1537cbcd87656
Nov 22 16:28:36 user nova-compute[75734]: INFO nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbed974025dbee69cdd5b93d001ad7e033f0edd7
Nov 22 16:28:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Verification complete {{(pid=75734) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 22 16:28:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Verify swap images {{(pid=75734) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 22 16:28:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.imagecache [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Verify ephemeral images {{(pid=75734) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 22 16:28:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:28:39 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Creating image(s)
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Ensure instance console log exists: /opt/stack/data/nova/instances/5f6fb556-084d-433d-8546-4271f294cb27/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Start _get_guest_xml network_info=[{"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6500c28a-5c99-470c-86ec-2071dc05f192', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f6fb556-084d-433d-8546-4271f294cb27', 'attached_at': '', 'detached_at': '', 'volume_id': 'af3928b7-cb19-4c30-ab14-2215346c9950', 'serial': 'af3928b7-cb19-4c30-ab14-2215346c9950'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:28:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:28:39 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:28:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:28:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:28:39 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c2f73-1419-46eb-90b4-3af3ea024401]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:28:39 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a6038-059f-4b36-9f4e-41a1420f597b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950] added
Nov 22 16:28:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd923c87-0f37-4330-bfc5-2646d0f4e9c5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65321b-3869-4d02-8b85-c15a82adee6a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFmxnElh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFmxnElh" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea9d76-7d9c-4a1a-a821-a73f11a6d847]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFmxnElh'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad56c136-0a16-4dfb-9527-7822ce9c41e1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec37147-3c52-451d-93d3-d6ca59d099c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:28:39 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:28:39 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:28:39 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:28:39 user nova-compute[75734]: 
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a054c-2da0-4ecd-8a97-b8e29891493b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]
Nov 22 16:28:39 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.
Nov 22 16:28:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc25cca7-8997-46eb-9fb9-abd442cecbd3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9775589-bbd5-404c-8e42-6b4a1eaf2fca]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:28:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:28:39 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae7de6d-1063-49cf-99dd-4354cc2ddd2e]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:28:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26534666133373636', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534666133373636', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296241725',display_name='tempest-TestVolumeBootPattern-server-1296241725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296241725',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-aw7j7ulu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:28:33Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=5f6fb556-084d-433d-8546-4271f294cb27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=7084d13b-7e67-4d98-87ab-fe6a9295d493,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7084d13b-7e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f6fb556-084d-433d-8546-4271f294cb27 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:28:40 user nova-compute[75734]:   <uuid>5f6fb556-084d-433d-8546-4271f294cb27</uuid>
Nov 22 16:28:40 user nova-compute[75734]:   <name>instance-0000002e</name>
Nov 22 16:28:40 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:28:40 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:28:40 user nova-compute[75734]:   <metadata>
Nov 22 16:28:40 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:28:40 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:28:40 user nova-compute[75734]:       <nova:name>tempest-TestVolumeBootPattern-server-1296241725</nova:name>
Nov 22 16:28:40 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:28:39</nova:creationTime>
Nov 22 16:28:40 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:28:40 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:28:40 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:28:40 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:28:40 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:28:40 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:28:40 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:28:40 user nova-compute[75734]:       <nova:owner>
Nov 22 16:28:40 user nova-compute[75734]:         <nova:user uuid="0aea0c396dc748bb8f8637981676ea72">tempest-TestVolumeBootPattern-318400595-project-member</nova:user>
Nov 22 16:28:40 user nova-compute[75734]:         <nova:project uuid="0532683a0b9b4d65b6c24a9fd2c6bf23">tempest-TestVolumeBootPattern-318400595</nova:project>
Nov 22 16:28:40 user nova-compute[75734]:       </nova:owner>
Nov 22 16:28:40 user nova-compute[75734]:       <nova:ports>
Nov 22 16:28:40 user nova-compute[75734]:         <nova:port uuid="7084d13b-7e67-4d98-87ab-fe6a9295d493">
Nov 22 16:28:40 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 16:28:40 user nova-compute[75734]:         </nova:port>
Nov 22 16:28:40 user nova-compute[75734]:       </nova:ports>
Nov 22 16:28:40 user nova-compute[75734]:     </nova:instance>
Nov 22 16:28:40 user nova-compute[75734]:   </metadata>
Nov 22 16:28:40 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:28:40 user nova-compute[75734]:     <system>
Nov 22 16:28:40 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:28:40 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:28:40 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:28:40 user nova-compute[75734]:       <entry name="serial">5f6fb556-084d-433d-8546-4271f294cb27</entry>
Nov 22 16:28:40 user nova-compute[75734]:       <entry name="uuid">5f6fb556-084d-433d-8546-4271f294cb27</entry>
Nov 22 16:28:40 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:28:40 user nova-compute[75734]:     </system>
Nov 22 16:28:40 user nova-compute[75734]:   </sysinfo>
Nov 22 16:28:40 user nova-compute[75734]:   <os>
Nov 22 16:28:40 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:28:40 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:28:40 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:28:40 user nova-compute[75734]:   </os>
Nov 22 16:28:40 user nova-compute[75734]:   <features>
Nov 22 16:28:40 user nova-compute[75734]:     <acpi/>
Nov 22 16:28:40 user nova-compute[75734]:     <apic/>
Nov 22 16:28:40 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:28:40 user nova-compute[75734]:   </features>
Nov 22 16:28:40 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:28:40 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:28:40 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:28:40 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:28:40 user nova-compute[75734]:   </clock>
Nov 22 16:28:40 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:28:40 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:28:40 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:28:40 user nova-compute[75734]:   </cpu>
Nov 22 16:28:40 user nova-compute[75734]:   <devices>
Nov 22 16:28:40 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:28:40 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:28:40 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:28:40 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:28:40 user nova-compute[75734]:       <serial>af3928b7-cb19-4c30-ab14-2215346c9950</serial>
Nov 22 16:28:40 user nova-compute[75734]:     </disk>
Nov 22 16:28:40 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:28:40 user nova-compute[75734]:       <mac address="fa:16:3e:b9:c8:4f"/>
Nov 22 16:28:40 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:28:40 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:28:40 user nova-compute[75734]:       <target dev="tap7084d13b-7e"/>
Nov 22 16:28:40 user nova-compute[75734]:     </interface>
Nov 22 16:28:40 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:28:40 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/5f6fb556-084d-433d-8546-4271f294cb27/console.log" append="off"/>
Nov 22 16:28:40 user nova-compute[75734]:     </serial>
Nov 22 16:28:40 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:28:40 user nova-compute[75734]:     <video>
Nov 22 16:28:40 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:28:40 user nova-compute[75734]:     </video>
Nov 22 16:28:40 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:28:40 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:28:40 user nova-compute[75734]:     </rng>
Nov 22 16:28:40 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:28:40 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:28:40 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:28:40 user nova-compute[75734]:     </memballoon>
Nov 22 16:28:40 user nova-compute[75734]:   </devices>
Nov 22 16:28:40 user nova-compute[75734]: </domain>
Nov 22 16:28:40 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296241725',display_name='tempest-TestVolumeBootPattern-server-1296241725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296241725',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-aw7j7ulu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:28:33Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=5f6fb556-084d-433d-8546-4271f294cb27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=7084d13b-7e67-4d98-87ab-fe6a9295d493,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7084d13b-7e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG os_vif [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=7084d13b-7e67-4d98-87ab-fe6a9295d493,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7084d13b-7e') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f60e2e23-6668-595c-87cf-cc0997bc80ad', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7084d13b-7e, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7084d13b-7e, col_values=(('qos', UUID('9cee4d81-598b-4f2e-bc66-d5442466b1df')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7084d13b-7e, col_values=(('external_ids', {'iface-id': '7084d13b-7e67-4d98-87ab-fe6a9295d493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:c8:4f', 'vm-uuid': '5f6fb556-084d-433d-8546-4271f294cb27'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:40 user nova-compute[75734]: INFO os_vif [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=7084d13b-7e67-4d98-87ab-fe6a9295d493,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7084d13b-7e')
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:28:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No VIF found with MAC fa:16:3e:b9:c8:4f, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-b0c48df8-6696-4cdf-9fa3-842207b61af4 req-640ffacd-898b-4b6f-b007-b550105b4adb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b0c48df8-6696-4cdf-9fa3-842207b61af4 req-640ffacd-898b-4b6f-b007-b550105b4adb service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b0c48df8-6696-4cdf-9fa3-842207b61af4 req-640ffacd-898b-4b6f-b007-b550105b4adb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b0c48df8-6696-4cdf-9fa3-842207b61af4 req-640ffacd-898b-4b6f-b007-b550105b4adb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG nova.compute.manager [req-b0c48df8-6696-4cdf-9fa3-842207b61af4 req-640ffacd-898b-4b6f-b007-b550105b4adb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:28:42 user nova-compute[75734]: WARNING nova.compute.manager [req-b0c48df8-6696-4cdf-9fa3-842207b61af4 req-640ffacd-898b-4b6f-b007-b550105b4adb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received unexpected event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with vm_state building and task_state spawning.
Nov 22 16:28:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:28:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Instance spawned successfully.
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:28:44 user nova-compute[75734]: INFO nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Took 4.85 seconds to spawn the instance on the hypervisor.
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:28:44 user nova-compute[75734]: INFO nova.compute.manager [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Took 11.67 seconds to build instance.
Nov 22 16:28:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0d7a710d-7d2e-4685-8aaf-f5f2667060e6 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "5f6fb556-084d-433d-8546-4271f294cb27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.769s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-cf6e26a5-290b-49e2-bcc3-77aa8553cb7c req-d59c205d-b07c-43a1-9769-712bef8adce6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cf6e26a5-290b-49e2-bcc3-77aa8553cb7c req-d59c205d-b07c-43a1-9769-712bef8adce6 service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cf6e26a5-290b-49e2-bcc3-77aa8553cb7c req-d59c205d-b07c-43a1-9769-712bef8adce6 service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cf6e26a5-290b-49e2-bcc3-77aa8553cb7c req-d59c205d-b07c-43a1-9769-712bef8adce6 service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:28:44 user nova-compute[75734]: DEBUG nova.compute.manager [req-cf6e26a5-290b-49e2-bcc3-77aa8553cb7c req-d59c205d-b07c-43a1-9769-712bef8adce6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:28:44 user nova-compute[75734]: WARNING nova.compute.manager [req-cf6e26a5-290b-49e2-bcc3-77aa8553cb7c req-d59c205d-b07c-43a1-9769-712bef8adce6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received unexpected event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with vm_state active and task_state None.
Nov 22 16:28:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:28:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:09 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:29:09 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:29:10 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:10 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:11 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:29:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:29:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:29:11 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:29:11 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:29:11 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:12 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:29:12 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=24.993606567382812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5f6fb556-084d-433d-8546-4271f294cb27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:29:12 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:29:13 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:29:13 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:29:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:29:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:29:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:29:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:29:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:29:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:29:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:29:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:29:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:29:18 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:29:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:29:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:29:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:29:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:29:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:29:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:29:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:29:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:29:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:26 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:29:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:29:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:29:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:29:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:29:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:29:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:29:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-changed-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:29:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Refreshing instance network info cache due to event network-changed-1d20b284-9bd0-4029-acd9-5ff0b5f788b7. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:29:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:29:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:29:41 user nova-compute[75734]: DEBUG nova.network.neutron [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Refreshing network info cache for port 1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:29:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:42 user nova-compute[75734]: DEBUG nova.network.neutron [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated VIF entry in instance network info cache for port 1d20b284-9bd0-4029-acd9-5ff0b5f788b7. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:29:42 user nova-compute[75734]: DEBUG nova.network.neutron [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:29:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a961441e-bf7a-4305-8d22-f4ed41d9f251 req-59ef473b-76c2-4c61-b892-5e68e2f3a4f6 service nova] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:29:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:29:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:29:45 user nova-compute[75734]: DEBUG nova.objects.instance [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:29:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:29:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:29:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:29:45 user nova-compute[75734]: INFO nova.compute.manager [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Attaching volume 9d60cbe1-2e0a-4981-a160-8209ea6c10c6 to /dev/vdb
Nov 22 16:29:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG os_brick.utils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f23f80-0825-48df-8fcc-af7222d98df5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f56bee7-c373-4a0b-8a4a-edd7769bb000]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c677f4-110b-45f3-88e3-f1d75ce68029]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab973a30-ffc9-4696-8b04-ec89f9be071a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:29:46 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:29:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[66902d5b-9596-46e1-a898-0a72584ef92a]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG os_brick.utils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:29:46 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating existing volume attachment record: 1adc11ab-8803-4e4f-8ba1-2945491a95ac {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:29:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibEzjdts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:29:51 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:29:51 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:29:51 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe9eda4-9077-4124-8bf0-2a89c770d3b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:29:51 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba7f18c-a288-4cb5-99dc-276dcdf4e752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6] added
Nov 22 16:29:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[53695ede-1b69-4989-a7a0-ece5872d364a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[45471775-e470-4baa-9761-4b2d4fdbeb02]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibEzjdts {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibEzjdts" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e96cd-49d2-4097-8cda-659c070c175e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ibEzjdts'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd904d25-07b6-40d8-9ae6-0b8645b19bd3]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[11580b7e-d124-4dfe-a89d-2376d1c07fc1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:29:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:29:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a195cdf9-9385-4c6c-a037-efe53afb95f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]
Nov 22 16:29:51 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.
Nov 22 16:29:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d0a0e-5217-46b2-b2a9-854e6a429c63]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5b0669-b3eb-4098-9275-7ff3c46e21c2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:29:51 user nova-compute[75734]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:29:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:29:51 user nova-compute[75734]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:29:51 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:29:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:29:52 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:29:52 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d7941b-de13-412d-941f-260c0d5301fb]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:29:52 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:29:52 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibEzjdts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:29:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23066346538656134', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066346538656134', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG nova.objects.instance [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:29:53 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:29:53 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:29:53 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:29:53 user nova-compute[75734]:   <serial>9d60cbe1-2e0a-4981-a160-8209ea6c10c6</serial>
Nov 22 16:29:53 user nova-compute[75734]: </disk>
Nov 22 16:29:53 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No VIF found with MAC fa:16:3e:04:2d:65, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:29:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-eadfc06e-d5aa-47bc-a65d-e552be821758 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.628s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b804c5d4-a15e-40dc-9e5b-14d85f4c27fe tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b804c5d4-a15e-40dc-9e5b-14d85f4c27fe tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b804c5d4-a15e-40dc-9e5b-14d85f4c27fe tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b804c5d4-a15e-40dc-9e5b-14d85f4c27fe tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75734) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG nova.objects.instance [None req-b804c5d4-a15e-40dc-9e5b-14d85f4c27fe tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-57e21df7-e1f5-40b7-8513-e5c6ebfc645e req-b2e8d963-a6b8-483e-a22a-cf97e9638516 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:29:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-57e21df7-e1f5-40b7-8513-e5c6ebfc645e req-b2e8d963-a6b8-483e-a22a-cf97e9638516 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:29:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-57e21df7-e1f5-40b7-8513-e5c6ebfc645e req-b2e8d963-a6b8-483e-a22a-cf97e9638516 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:29:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-57e21df7-e1f5-40b7-8513-e5c6ebfc645e req-b2e8d963-a6b8-483e-a22a-cf97e9638516 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:29:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-57e21df7-e1f5-40b7-8513-e5c6ebfc645e req-b2e8d963-a6b8-483e-a22a-cf97e9638516 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:29:55 user nova-compute[75734]: WARNING nova.compute.manager [req-57e21df7-e1f5-40b7-8513-e5c6ebfc645e req-b2e8d963-a6b8-483e-a22a-cf97e9638516 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state active and task_state powering-off.
Nov 22 16:29:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:55 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance destroyed successfully.
Nov 22 16:29:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-b804c5d4-a15e-40dc-9e5b-14d85f4c27fe tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:29:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-b804c5d4-a15e-40dc-9e5b-14d85f4c27fe tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.863s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:29:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:29:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-c08be212-2bd8-4922-8bff-eb556c9d4752 req-cbac3ee2-f326-4ece-9bb7-72a30fc50ec0 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:29:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c08be212-2bd8-4922-8bff-eb556c9d4752 req-cbac3ee2-f326-4ece-9bb7-72a30fc50ec0 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:29:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c08be212-2bd8-4922-8bff-eb556c9d4752 req-cbac3ee2-f326-4ece-9bb7-72a30fc50ec0 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:29:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c08be212-2bd8-4922-8bff-eb556c9d4752 req-cbac3ee2-f326-4ece-9bb7-72a30fc50ec0 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:29:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-c08be212-2bd8-4922-8bff-eb556c9d4752 req-cbac3ee2-f326-4ece-9bb7-72a30fc50ec0 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:29:57 user nova-compute[75734]: WARNING nova.compute.manager [req-c08be212-2bd8-4922-8bff-eb556c9d4752 req-cbac3ee2-f326-4ece-9bb7-72a30fc50ec0 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state None.
Nov 22 16:29:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:30:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:30:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:30:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:30:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:30:13 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:30:13 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=24.992454528808594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 5f6fb556-084d-433d-8546-4271f294cb27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:30:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:14 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:30:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:30:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:17 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:20 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:30:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:30:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:30:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:30:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:21 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updating instance_info_cache with network_info: [{"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:30:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:30:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:30:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-changed-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Refreshing instance network info cache due to event network-changed-7084d13b-7e67-4d98-87ab-fe6a9295d493. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:30:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] Acquiring lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:30:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] Acquired lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:30:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Refreshing network info cache for port 7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updated VIF entry in instance network info cache for port 7084d13b-7e67-4d98-87ab-fe6a9295d493. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updating instance_info_cache with network_info: [{"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f870e2f0-b95e-4c89-80c9-d91715b097f4 req-8a4bb7a3-c903-4d6b-b76b-bc64fb8a70b6 service nova] Releasing lock "refresh_cache-5f6fb556-084d-433d-8546-4271f294cb27" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "5f6fb556-084d-433d-8546-4271f294cb27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:25 user nova-compute[75734]: INFO nova.compute.manager [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Terminating instance
Nov 22 16:30:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-76bef962-66f3-4f2d-8e0c-d64f550ff7ca req-e9f0e640-71b7-44a2-94e4-a360d2ba65e3 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-unplugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76bef962-66f3-4f2d-8e0c-d64f550ff7ca req-e9f0e640-71b7-44a2-94e4-a360d2ba65e3 service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76bef962-66f3-4f2d-8e0c-d64f550ff7ca req-e9f0e640-71b7-44a2-94e4-a360d2ba65e3 service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-76bef962-66f3-4f2d-8e0c-d64f550ff7ca req-e9f0e640-71b7-44a2-94e4-a360d2ba65e3 service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-76bef962-66f3-4f2d-8e0c-d64f550ff7ca req-e9f0e640-71b7-44a2-94e4-a360d2ba65e3 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-unplugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-76bef962-66f3-4f2d-8e0c-d64f550ff7ca req-e9f0e640-71b7-44a2-94e4-a360d2ba65e3 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-unplugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:30:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Instance destroyed successfully.
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.objects.instance [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'resources' on Instance uuid 5f6fb556-084d-433d-8546-4271f294cb27 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296241725',display_name='tempest-TestVolumeBootPattern-server-1296241725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296241725',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:28:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-aw7j7ulu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:28:44Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=5f6fb556-084d-433d-8546-4271f294cb27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "address": "fa:16:3e:b9:c8:4f", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7084d13b-7e", "ovs_interfaceid": "7084d13b-7e67-4d98-87ab-fe6a9295d493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=7084d13b-7e67-4d98-87ab-fe6a9295d493,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7084d13b-7e') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_vif [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=7084d13b-7e67-4d98-87ab-fe6a9295d493,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7084d13b-7e') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7084d13b-7e, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cee4d81-598b-4f2e-bc66-d5442466b1df) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: INFO os_vif [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=7084d13b-7e67-4d98-87ab-fe6a9295d493,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7084d13b-7e')
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:30:26 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb83840-0e28-4a43-9072-63b76dbafab3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:30:26 user nova-compute[75734]: No targets found.
Nov 22 16:30:26 user nova-compute[75734]: iSNS:
Nov 22 16:30:26 user nova-compute[75734]: No targets found.
Nov 22 16:30:26 user nova-compute[75734]: STATIC:
Nov 22 16:30:26 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950
Nov 22 16:30:26 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:30:26 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:30:26 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6
Nov 22 16:30:26 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:30:26 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:30:26 user nova-compute[75734]: FIRMWARE:
Nov 22 16:30:26 user nova-compute[75734]: No targets found.
Nov 22 16:30:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:30:26 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:30:26 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1278f8b-bb02-4309-b2ce-5269e9244440]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[58515c40-4458-48a8-9e01-47b252f4905a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:30:26 user nova-compute[75734]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:30:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:30:26 user nova-compute[75734]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:30:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ec40e6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91e078e-173f-4084-bc4e-74e766f7bcbb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc4fded-193e-40ff-b805-65f8390d814b]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a611767-03b3-4bc7-bea8-c959431981eb]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[84517cf7-d0f3-4b7a-9a25-a3c0959839a4]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ae80c6-5404-4a52-8fbe-bcfbbe38d812]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e2441-a772-4f22-97d4-1f580ba28dd3]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]
Nov 22 16:30:26 user nova-compute[75734]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.
Nov 22 16:30:26 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1c15da-a33f-4b7b-96b0-bf3a4761042c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== disconnect_volume: return (350ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:30:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Deleting instance files /opt/stack/data/nova/instances/5f6fb556-084d-433d-8546-4271f294cb27_del
Nov 22 16:30:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Deletion of /opt/stack/data/nova/instances/5f6fb556-084d-433d-8546-4271f294cb27_del complete
Nov 22 16:30:26 user nova-compute[75734]: INFO nova.compute.manager [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 22 16:30:26 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:30:27 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Took 0.72 seconds to deallocate network for instance.
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-f3d46962-ee37-40eb-bbc0-18261961db08 req-d85cef75-b560-4f94-bed2-5abe566ec205 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-deleted-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:27 user nova-compute[75734]: INFO nova.compute.manager [req-f3d46962-ee37-40eb-bbc0-18261961db08 req-d85cef75-b560-4f94-bed2-5abe566ec205 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Neutron deleted interface 7084d13b-7e67-4d98-87ab-fe6a9295d493; detaching it from the instance and deleting it from the info cache
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-f3d46962-ee37-40eb-bbc0-18261961db08 req-d85cef75-b560-4f94-bed2-5abe566ec205 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-f3d46962-ee37-40eb-bbc0-18261961db08 req-d85cef75-b560-4f94-bed2-5abe566ec205 service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Detach interface failed, port_id=7084d13b-7e67-4d98-87ab-fe6a9295d493, reason: Instance 5f6fb556-084d-433d-8546-4271f294cb27 could not be found. {{(pid=75734) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:30:27 user nova-compute[75734]: WARNING nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received unexpected event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with vm_state active and task_state deleting.
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:30:27 user nova-compute[75734]: WARNING nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received unexpected event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with vm_state active and task_state deleting.
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:30:27 user nova-compute[75734]: WARNING nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received unexpected event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with vm_state active and task_state deleting.
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-unplugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-unplugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-unplugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Acquiring lock "5f6fb556-084d-433d-8546-4271f294cb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] Lock "5f6fb556-084d-433d-8546-4271f294cb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] No waiting events found dispatching network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:30:27 user nova-compute[75734]: WARNING nova.compute.manager [req-33053d37-0818-4d94-adda-4c3201b77920 req-bdea5fc7-165d-4c92-9bd5-e137429e84cb service nova] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Received unexpected event network-vif-plugged-7084d13b-7e67-4d98-87ab-fe6a9295d493 for instance with vm_state active and task_state deleting.
Nov 22 16:30:28 user nova-compute[75734]: INFO nova.compute.manager [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 5f6fb556-084d-433d-8546-4271f294cb27] Took 0.76 seconds to detach 1 volumes for instance.
Nov 22 16:30:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:28 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:30:28 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:30:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:28 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Deleted allocations for instance 5f6fb556-084d-433d-8546-4271f294cb27
Nov 22 16:30:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-dce6c0bc-b607-4363-ada9-f931cab4f96d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "5f6fb556-084d-433d-8546-4271f294cb27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.081s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:30:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:30:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:30:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:30:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:30:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:30:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:30:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:30:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:30:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:31:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:31:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:31:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:31:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:31:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:31:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:12 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:31:14 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:31:14 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9169MB free_disk=24.99146270751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:31:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:31:17 user nova-compute[75734]: INFO nova.compute.claims [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Claim successful on node user
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:31:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:31:17 user nova-compute[75734]: INFO nova.virt.block_device [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Booting with volume af3928b7-cb19-4c30-ab14-2215346c9950 at /dev/vda
Nov 22 16:31:17 user nova-compute[75734]: DEBUG os_brick.utils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a28408f-fac5-4f17-bf71-3266bbbd0706]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.policy [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aea0c396dc748bb8f8637981676ea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0532683a0b9b4d65b6c24a9fd2c6bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbe0f66-9b05-4cdf-a54b-da41d94d9f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0bc8a9-2d4f-431d-8d0c-fdee57f898ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb837eb8-d180-4f3d-aa16-71495adae7e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:31:17 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:31:17 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec8bc4-eebb-4854-a7aa-1d7d62a1eec3]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG os_brick.utils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:31:17 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating existing volume attachment record: 2f3b703c-dca3-4ca2-aaad-d9720c5c39f2 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:31:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Successfully created port: e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Successfully updated port: e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquired lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-changed-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Refreshing instance network info cache due to event network-changed-e8c92fb1-c52f-4414-ae07-c352be87310b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] Acquiring lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating instance_info_cache with network_info: [{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Releasing lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Instance network_info: |[{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] Acquired lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Refreshing network info cache for port e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updated VIF entry in instance network info cache for port e8c92fb1-c52f-4414-ae07-c352be87310b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating instance_info_cache with network_info: [{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:31:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7416cf49-c827-4bbe-800a-3ddf8e6d6d9d req-f50d553b-c34e-44b9-b6aa-a4cedf213a93 service nova] Releasing lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Skipping network cache update for instance because it is Building. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:31:21 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:22 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:31:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:31:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:31:22 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:31:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Creating image(s)
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Ensure instance console log exists: /opt/stack/data/nova/instances/81d0af64-feba-4492-a013-4e9954e6f8cb/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Start _get_guest_xml network_info=[{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2f3b703c-dca3-4ca2-aaad-d9720c5c39f2', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81d0af64-feba-4492-a013-4e9954e6f8cb', 'attached_at': '', 'detached_at': '', 'volume_id': 'af3928b7-cb19-4c30-ab14-2215346c9950', 'serial': 'af3928b7-cb19-4c30-ab14-2215346c9950'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:31:23 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:31:23 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:31:23 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:31:23 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:31:23 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ec83cd-fd87-4f42-b0ab-f8ce3a06bf01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:31:23 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4951d04b-ddd2-4ddb-9c8a-1b6f24fe0bc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950] added
Nov 22 16:31:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac64b6cb-f8c0-473a-acf4-7a8c4d87b9c1]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f2df30-9336-48f6-9e79-2e96cf28cb12]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFmxnElh {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFmxnElh" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d05b4-341a-4039-8f45-7a3d6a73426b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFmxnElh'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2379923-65da-42a9-b44a-c6cf07d5a87c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c6d0a8-073f-48e8-9573-c1975f77eee5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:31:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e097f-a268-422e-85db-30b0716195ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]
Nov 22 16:31:24 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.
Nov 22 16:31:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca1045-44e9-4f89-a706-730ea4e50dfb]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[68640b9f-0331-4ff7-ab01-68d6a1d8e2a1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:24 user nova-compute[75734]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:24 user nova-compute[75734]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:24 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6df18f-1d1d-4c7c-9b03-6c8ff3b6241b]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26534666133373636', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534666133373636', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-389227585',display_name='tempest-TestVolumeBootPattern-server-389227585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-389227585',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-h0ql83of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:31:18Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=81d0af64-feba-4492-a013-4e9954e6f8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a3:41,bridge_name='br-int',has_traffic_filtering=True,id=e8c92fb1-c52f-4414-ae07-c352be87310b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c92fb1-c5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.objects.instance [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'pci_devices' on Instance uuid 81d0af64-feba-4492-a013-4e9954e6f8cb {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:31:25 user nova-compute[75734]:   <uuid>81d0af64-feba-4492-a013-4e9954e6f8cb</uuid>
Nov 22 16:31:25 user nova-compute[75734]:   <name>instance-0000002f</name>
Nov 22 16:31:25 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:31:25 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:31:25 user nova-compute[75734]:   <metadata>
Nov 22 16:31:25 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:31:25 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:31:25 user nova-compute[75734]:       <nova:name>tempest-TestVolumeBootPattern-server-389227585</nova:name>
Nov 22 16:31:25 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:31:23</nova:creationTime>
Nov 22 16:31:25 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:31:25 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:31:25 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:31:25 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:31:25 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:31:25 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:31:25 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:31:25 user nova-compute[75734]:       <nova:owner>
Nov 22 16:31:25 user nova-compute[75734]:         <nova:user uuid="0aea0c396dc748bb8f8637981676ea72">tempest-TestVolumeBootPattern-318400595-project-member</nova:user>
Nov 22 16:31:25 user nova-compute[75734]:         <nova:project uuid="0532683a0b9b4d65b6c24a9fd2c6bf23">tempest-TestVolumeBootPattern-318400595</nova:project>
Nov 22 16:31:25 user nova-compute[75734]:       </nova:owner>
Nov 22 16:31:25 user nova-compute[75734]:       <nova:ports>
Nov 22 16:31:25 user nova-compute[75734]:         <nova:port uuid="e8c92fb1-c52f-4414-ae07-c352be87310b">
Nov 22 16:31:25 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 16:31:25 user nova-compute[75734]:         </nova:port>
Nov 22 16:31:25 user nova-compute[75734]:       </nova:ports>
Nov 22 16:31:25 user nova-compute[75734]:     </nova:instance>
Nov 22 16:31:25 user nova-compute[75734]:   </metadata>
Nov 22 16:31:25 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:31:25 user nova-compute[75734]:     <system>
Nov 22 16:31:25 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:31:25 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:31:25 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:31:25 user nova-compute[75734]:       <entry name="serial">81d0af64-feba-4492-a013-4e9954e6f8cb</entry>
Nov 22 16:31:25 user nova-compute[75734]:       <entry name="uuid">81d0af64-feba-4492-a013-4e9954e6f8cb</entry>
Nov 22 16:31:25 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:31:25 user nova-compute[75734]:     </system>
Nov 22 16:31:25 user nova-compute[75734]:   </sysinfo>
Nov 22 16:31:25 user nova-compute[75734]:   <os>
Nov 22 16:31:25 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:31:25 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:31:25 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:31:25 user nova-compute[75734]:   </os>
Nov 22 16:31:25 user nova-compute[75734]:   <features>
Nov 22 16:31:25 user nova-compute[75734]:     <acpi/>
Nov 22 16:31:25 user nova-compute[75734]:     <apic/>
Nov 22 16:31:25 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:31:25 user nova-compute[75734]:   </features>
Nov 22 16:31:25 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:31:25 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:31:25 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:31:25 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:31:25 user nova-compute[75734]:   </clock>
Nov 22 16:31:25 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:31:25 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:31:25 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:31:25 user nova-compute[75734]:   </cpu>
Nov 22 16:31:25 user nova-compute[75734]:   <devices>
Nov 22 16:31:25 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:31:25 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:31:25 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:31:25 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:31:25 user nova-compute[75734]:       <serial>af3928b7-cb19-4c30-ab14-2215346c9950</serial>
Nov 22 16:31:25 user nova-compute[75734]:     </disk>
Nov 22 16:31:25 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:31:25 user nova-compute[75734]:       <mac address="fa:16:3e:2e:a3:41"/>
Nov 22 16:31:25 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:31:25 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:31:25 user nova-compute[75734]:       <target dev="tape8c92fb1-c5"/>
Nov 22 16:31:25 user nova-compute[75734]:     </interface>
Nov 22 16:31:25 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:31:25 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/81d0af64-feba-4492-a013-4e9954e6f8cb/console.log" append="off"/>
Nov 22 16:31:25 user nova-compute[75734]:     </serial>
Nov 22 16:31:25 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:31:25 user nova-compute[75734]:     <video>
Nov 22 16:31:25 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:31:25 user nova-compute[75734]:     </video>
Nov 22 16:31:25 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:31:25 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:31:25 user nova-compute[75734]:     </rng>
Nov 22 16:31:25 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:31:25 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:31:25 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:31:25 user nova-compute[75734]:     </memballoon>
Nov 22 16:31:25 user nova-compute[75734]:   </devices>
Nov 22 16:31:25 user nova-compute[75734]: </domain>
Nov 22 16:31:25 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-389227585',display_name='tempest-TestVolumeBootPattern-server-389227585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-389227585',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-h0ql83of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:31:18Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=81d0af64-feba-4492-a013-4e9954e6f8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a3:41,bridge_name='br-int',has_traffic_filtering=True,id=e8c92fb1-c52f-4414-ae07-c352be87310b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c92fb1-c5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG os_vif [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a3:41,bridge_name='br-int',has_traffic_filtering=True,id=e8c92fb1-c52f-4414-ae07-c352be87310b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c92fb1-c5') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93ec0d30-4b50-5603-8138-1a899c5d21f7', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c92fb1-c5, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8c92fb1-c5, col_values=(('qos', UUID('50653f54-3cae-48d1-818d-69f11ff2409f')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8c92fb1-c5, col_values=(('external_ids', {'iface-id': 'e8c92fb1-c52f-4414-ae07-c352be87310b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:a3:41', 'vm-uuid': '81d0af64-feba-4492-a013-4e9954e6f8cb'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:25 user nova-compute[75734]: INFO os_vif [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a3:41,bridge_name='br-int',has_traffic_filtering=True,id=e8c92fb1-c52f-4414-ae07-c352be87310b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c92fb1-c5')
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:31:25 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No VIF found with MAC fa:16:3e:2e:a3:41, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-4c2c9fd2-bc08-4588-976a-6a82357fe7f9 req-82a18998-7b38-4d91-a772-68a21f8971b1 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4c2c9fd2-bc08-4588-976a-6a82357fe7f9 req-82a18998-7b38-4d91-a772-68a21f8971b1 service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4c2c9fd2-bc08-4588-976a-6a82357fe7f9 req-82a18998-7b38-4d91-a772-68a21f8971b1 service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4c2c9fd2-bc08-4588-976a-6a82357fe7f9 req-82a18998-7b38-4d91-a772-68a21f8971b1 service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-4c2c9fd2-bc08-4588-976a-6a82357fe7f9 req-82a18998-7b38-4d91-a772-68a21f8971b1 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:31:26 user nova-compute[75734]: WARNING nova.compute.manager [req-4c2c9fd2-bc08-4588-976a-6a82357fe7f9 req-82a18998-7b38-4d91-a772-68a21f8971b1 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received unexpected event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with vm_state building and task_state spawning.
Nov 22 16:31:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:31:28 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Instance spawned successfully.
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:31:28 user nova-compute[75734]: INFO nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:31:28 user nova-compute[75734]: INFO nova.compute.manager [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Took 11.59 seconds to build instance.
Nov 22 16:31:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e88cad9b-56f6-4a42-b6e7-650e9a55963f tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.683s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-ba2c76bc-dd8a-48ef-8b38-c72776a5d46d req-01b15269-e2f6-44d1-8b4f-e6d2b6d10646 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ba2c76bc-dd8a-48ef-8b38-c72776a5d46d req-01b15269-e2f6-44d1-8b4f-e6d2b6d10646 service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ba2c76bc-dd8a-48ef-8b38-c72776a5d46d req-01b15269-e2f6-44d1-8b4f-e6d2b6d10646 service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-ba2c76bc-dd8a-48ef-8b38-c72776a5d46d req-01b15269-e2f6-44d1-8b4f-e6d2b6d10646 service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:28 user nova-compute[75734]: DEBUG nova.compute.manager [req-ba2c76bc-dd8a-48ef-8b38-c72776a5d46d req-01b15269-e2f6-44d1-8b4f-e6d2b6d10646 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:31:28 user nova-compute[75734]: WARNING nova.compute.manager [req-ba2c76bc-dd8a-48ef-8b38-c72776a5d46d req-01b15269-e2f6-44d1-8b4f-e6d2b6d10646 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received unexpected event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with vm_state active and task_state None.
Nov 22 16:31:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:31:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.objects.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:31:45 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance destroyed successfully.
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'resources' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.objects.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_vif [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d20b284-9b, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b54e5a77-6a75-4ffa-932b-11ba9a06eacb) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:45 user nova-compute[75734]: INFO os_vif [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b')
Nov 22 16:31:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibEzjdts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:31:45 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e273c37b-02a1-474a-9196-0ad85015db68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:31:45 user nova-compute[75734]: No targets found.
Nov 22 16:31:45 user nova-compute[75734]: iSNS:
Nov 22 16:31:45 user nova-compute[75734]: No targets found.
Nov 22 16:31:45 user nova-compute[75734]: STATIC:
Nov 22 16:31:45 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950
Nov 22 16:31:45 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:31:45 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:31:45 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6
Nov 22 16:31:45 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:31:45 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:31:45 user nova-compute[75734]: FIRMWARE:
Nov 22 16:31:45 user nova-compute[75734]: No targets found.
Nov 22 16:31:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:31:45 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:31:45 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d3e79a-1ed1-4b10-a46d-49a33bee5020]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa812b-bfc0-40ed-b735-d346bfcf1d94]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:45 user nova-compute[75734]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:45 user nova-compute[75734]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7f2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:31:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e941454e-5785-44be-9775-54787271d744]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4b4f4-e5ec-4445-926f-b214a6371d9d]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd17f8b-128e-44e1-b20f-29b59d18ec02]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0f010-34eb-462b-a45f-a86f65aca495]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a8f605-6089-4d32-810c-5bb23e047e00]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0843d3a7-20c4-4905-a768-7208000784cf]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]
Nov 22 16:31:46 user nova-compute[75734]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.
Nov 22 16:31:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[96047960-dab2-44f2-bcc8-1aed671516f0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== disconnect_volume: return (276ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Start _get_guest_xml network_info=[{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1adc11ab-8803-4e4f-8ba1-2945491a95ac', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibEzjdts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f1ca4c7a-d634-4f34-af24-0e8d23ee3319', 'attached_at': '', 'detached_at': '', 'volume_id': '9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'serial': '9d60cbe1-2e0a-4981-a160-8209ea6c10c6'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'numa_topology' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.objects.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:31:46 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:31:46 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.objects.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibEzjdts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:31:46 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:31:46 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:31:46 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b22549-22c0-400a-a276-d46f90338bce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:31:46 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a3e3ad-4cfd-4a49-8455-f3b2effc8ddc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6] added
Nov 22 16:31:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8859e3a-4910-474a-a27e-d24011e5eebe]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced2ea3-2ef7-4202-9510-9fa02d47be51]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibEzjdts {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibEzjdts" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e10136d-e10d-4333-8715-8cbbc4f588b0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ibEzjdts'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac9c3db-8c48-42c9-a7a8-7921a9ea83d2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc81d8cb-ed15-445d-99b1-dcd90057e798]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a749a8a4-c0b1-4b68-9bab-0ddbc0edbc15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]
Nov 22 16:31:46 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.
Nov 22 16:31:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb6707-2af9-4dfb-843d-13444d5b8835]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f720e316-1ac0-4861-a296-680b433ffd6f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:46 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:31:46 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:31:46 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c49ac4-cd9b-44ae-a0ab-2764aaf9f16f]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:31:46 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibEzjdts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23066346538656134', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066346538656134', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'pci_devices' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.objects.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:31:47 user nova-compute[75734]:   <uuid>f1ca4c7a-d634-4f34-af24-0e8d23ee3319</uuid>
Nov 22 16:31:47 user nova-compute[75734]:   <name>instance-0000002d</name>
Nov 22 16:31:47 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:31:47 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:31:47 user nova-compute[75734]:   <metadata>
Nov 22 16:31:47 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:31:47 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:31:47 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeTestJSON-server-10626121</nova:name>
Nov 22 16:31:47 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:31:46</nova:creationTime>
Nov 22 16:31:47 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:31:47 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:31:47 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:31:47 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:31:47 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:31:47 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:31:47 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:31:47 user nova-compute[75734]:       <nova:owner>
Nov 22 16:31:47 user nova-compute[75734]:         <nova:user uuid="0f7b8124d8ef489496bcb5bab0e28710">tempest-AttachVolumeTestJSON-146842854-project-member</nova:user>
Nov 22 16:31:47 user nova-compute[75734]:         <nova:project uuid="3d22409cfae24b46923c4e5bc6639fdb">tempest-AttachVolumeTestJSON-146842854</nova:project>
Nov 22 16:31:47 user nova-compute[75734]:       </nova:owner>
Nov 22 16:31:47 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:31:47 user nova-compute[75734]:       <nova:ports>
Nov 22 16:31:47 user nova-compute[75734]:         <nova:port uuid="1d20b284-9bd0-4029-acd9-5ff0b5f788b7">
Nov 22 16:31:47 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:31:47 user nova-compute[75734]:         </nova:port>
Nov 22 16:31:47 user nova-compute[75734]:       </nova:ports>
Nov 22 16:31:47 user nova-compute[75734]:     </nova:instance>
Nov 22 16:31:47 user nova-compute[75734]:   </metadata>
Nov 22 16:31:47 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:31:47 user nova-compute[75734]:     <system>
Nov 22 16:31:47 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:31:47 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:31:47 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:31:47 user nova-compute[75734]:       <entry name="serial">f1ca4c7a-d634-4f34-af24-0e8d23ee3319</entry>
Nov 22 16:31:47 user nova-compute[75734]:       <entry name="uuid">f1ca4c7a-d634-4f34-af24-0e8d23ee3319</entry>
Nov 22 16:31:47 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:31:47 user nova-compute[75734]:     </system>
Nov 22 16:31:47 user nova-compute[75734]:   </sysinfo>
Nov 22 16:31:47 user nova-compute[75734]:   <os>
Nov 22 16:31:47 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:31:47 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:31:47 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:31:47 user nova-compute[75734]:   </os>
Nov 22 16:31:47 user nova-compute[75734]:   <features>
Nov 22 16:31:47 user nova-compute[75734]:     <acpi/>
Nov 22 16:31:47 user nova-compute[75734]:     <apic/>
Nov 22 16:31:47 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:31:47 user nova-compute[75734]:   </features>
Nov 22 16:31:47 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:31:47 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:31:47 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:31:47 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:31:47 user nova-compute[75734]:   </clock>
Nov 22 16:31:47 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:31:47 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:31:47 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:31:47 user nova-compute[75734]:   </cpu>
Nov 22 16:31:47 user nova-compute[75734]:   <devices>
Nov 22 16:31:47 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:31:47 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:31:47 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk"/>
Nov 22 16:31:47 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:31:47 user nova-compute[75734]:     </disk>
Nov 22 16:31:47 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:31:47 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:31:47 user nova-compute[75734]:       <source dev="/dev/sdc"/>
Nov 22 16:31:47 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:31:47 user nova-compute[75734]:       <serial>9d60cbe1-2e0a-4981-a160-8209ea6c10c6</serial>
Nov 22 16:31:47 user nova-compute[75734]:     </disk>
Nov 22 16:31:47 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:31:47 user nova-compute[75734]:       <mac address="fa:16:3e:04:2d:65"/>
Nov 22 16:31:47 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:31:47 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:31:47 user nova-compute[75734]:       <target dev="tap1d20b284-9b"/>
Nov 22 16:31:47 user nova-compute[75734]:     </interface>
Nov 22 16:31:47 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:31:47 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/console.log" append="off"/>
Nov 22 16:31:47 user nova-compute[75734]:     </serial>
Nov 22 16:31:47 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:31:47 user nova-compute[75734]:     <video>
Nov 22 16:31:47 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:31:47 user nova-compute[75734]:     </video>
Nov 22 16:31:47 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:31:47 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:31:47 user nova-compute[75734]:     </rng>
Nov 22 16:31:47 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:31:47 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:31:47 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:31:47 user nova-compute[75734]:     </memballoon>
Nov 22 16:31:47 user nova-compute[75734]:   </devices>
Nov 22 16:31:47 user nova-compute[75734]: </domain>
Nov 22 16:31:47 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:31:47 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.objects.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.166s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Cannot resize image /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'migration_context' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.objects.base [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG os_vif [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60cf23d9-9f4b-5736-88f1-d4aab1552b64', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d20b284-9b, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d20b284-9b, col_values=(('qos', UUID('3c19bc1f-dd96-4496-b346-b9ee1bdd17bc')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d20b284-9b, col_values=(('external_ids', {'iface-id': '1d20b284-9bd0-4029-acd9-5ff0b5f788b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:2d:65', 'vm-uuid': 'f1ca4c7a-d634-4f34-af24-0e8d23ee3319'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:31:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:48 user nova-compute[75734]: INFO os_vif [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b')
Nov 22 16:31:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-7cb13f14-10c6-4758-b020-dac462a39fa2 req-8c6cfd29-1812-400b-b9a8-9162402e04a8 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:31:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7cb13f14-10c6-4758-b020-dac462a39fa2 req-8c6cfd29-1812-400b-b9a8-9162402e04a8 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7cb13f14-10c6-4758-b020-dac462a39fa2 req-8c6cfd29-1812-400b-b9a8-9162402e04a8 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7cb13f14-10c6-4758-b020-dac462a39fa2 req-8c6cfd29-1812-400b-b9a8-9162402e04a8 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:49 user nova-compute[75734]: DEBUG nova.compute.manager [req-7cb13f14-10c6-4758-b020-dac462a39fa2 req-8c6cfd29-1812-400b-b9a8-9162402e04a8 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:31:49 user nova-compute[75734]: WARNING nova.compute.manager [req-7cb13f14-10c6-4758-b020-dac462a39fa2 req-8c6cfd29-1812-400b-b9a8-9162402e04a8 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state powering-on.
Nov 22 16:31:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:31:51 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance rebooted successfully.
Nov 22 16:31:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f4ec3e26-9dd3-4c26-b281-ada0530efaf3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:31:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-fa0a3222-4ac1-4cd8-866f-4b375cf3af39 req-67918472-0744-4b35-a21f-5934d68318c0 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:31:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fa0a3222-4ac1-4cd8-866f-4b375cf3af39 req-67918472-0744-4b35-a21f-5934d68318c0 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:31:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fa0a3222-4ac1-4cd8-866f-4b375cf3af39 req-67918472-0744-4b35-a21f-5934d68318c0 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:31:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fa0a3222-4ac1-4cd8-866f-4b375cf3af39 req-67918472-0744-4b35-a21f-5934d68318c0 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:31:51 user nova-compute[75734]: DEBUG nova.compute.manager [req-fa0a3222-4ac1-4cd8-866f-4b375cf3af39 req-67918472-0744-4b35-a21f-5934d68318c0 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:31:51 user nova-compute[75734]: WARNING nova.compute.manager [req-fa0a3222-4ac1-4cd8-866f-4b375cf3af39 req-67918472-0744-4b35-a21f-5934d68318c0 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state active and task_state None.
Nov 22 16:31:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:31:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:32:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:32:14 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:32:14 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=24.988983154296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 81d0af64-feba-4492-a013-4e9954e6f8cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:32:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:32:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:20 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:32:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:32:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:32:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:32:21 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:32:21 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:32:22 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:32:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:32:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:32:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:22 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:32:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:32:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:32:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:32:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:32:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:32:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:32:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:32:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:32:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:32:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:32:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:32:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:32:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-changed-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:33:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Refreshing instance network info cache due to event network-changed-e8c92fb1-c52f-4414-ae07-c352be87310b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:33:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] Acquiring lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:33:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] Acquired lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:33:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Refreshing network info cache for port e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:33:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updated VIF entry in instance network info cache for port e8c92fb1-c52f-4414-ae07-c352be87310b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:33:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating instance_info_cache with network_info: [{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:33:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-87d910ab-d45a-45ba-a756-d66a36ac6f55 req-7af96438-eaf8-47a9-847f-236d2a966257 service nova] Releasing lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:33:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:33:14 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:33:14 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.980224609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 81d0af64-feba-4492-a013-4e9954e6f8cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:33:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "c477e120-670d-471c-9f2c-4e2c9ad1154c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:33:16 user nova-compute[75734]: INFO nova.compute.claims [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Claim successful on node user
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.network.neutron [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:33:16 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.policy [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aea0c396dc748bb8f8637981676ea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0532683a0b9b4d65b6c24a9fd2c6bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:33:16 user nova-compute[75734]: INFO nova.virt.block_device [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Booting with volume ebb1f647-9058-4cbd-9f4a-9b8d2218a471 at /dev/vda
Nov 22 16:33:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d3e407-122a-4ae1-819b-b612df1d7017]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c40ad5-ebd2-40af-a5fe-921e44f4fc36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f480ccbb-f50d-4ae7-943f-0092dbd0d93b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a1f94-312f-4b53-b513-f36f59988d34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:33:16 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:33:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec1c22-90e1-4601-938b-c10cec812c80]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG os_brick.utils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:33:16 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updating existing volume attachment record: 072b1d0d-4eab-40f4-8e6a-6b409da30b16 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Successfully created port: 3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Successfully updated port: 3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquired lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-changed-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Refreshing instance network info cache due to event network-changed-3eb37077-2889-4e20-b3d8-78d28d24681b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:33:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] Acquiring lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updating instance_info_cache with network_info: [{"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Releasing lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Instance network_info: |[{"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] Acquired lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Refreshing network info cache for port 3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updated VIF entry in instance network info cache for port 3eb37077-2889-4e20-b3d8-78d28d24681b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG nova.network.neutron [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updating instance_info_cache with network_info: [{"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:33:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-07e049b3-891b-4a6e-921f-96f99c76ebca req-6b32f834-6f8c-41f1-8a87-f3414fa58273 service nova] Releasing lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:33:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:33:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:33:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:33:21 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating instance_info_cache with network_info: [{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:33:22 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Creating image(s)
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Did not create local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Ensure instance console log exists: /opt/stack/data/nova/instances/c477e120-670d-471c-9f2c-4e2c9ad1154c/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Start _get_guest_xml network_info=[{"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '072b1d0d-4eab-40f4-8e6a-6b409da30b16', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHFgWiUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c477e120-670d-471c-9f2c-4e2c9ad1154c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebb1f647-9058-4cbd-9f4a-9b8d2218a471', 'serial': 'ebb1f647-9058-4cbd-9f4a-9b8d2218a471'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:33:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:33:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHFgWiUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:33:22 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:33:22 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:33:22 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba44fb5-24d3-4e56-86a5-a59904e4c519]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:33:22 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9dcf45-b36d-41dc-bf61-d7bdb4d9670c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471] added
Nov 22 16:33:22 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48d5fd7-7ac2-49c6-90e9-795116dd36e4]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eca9c9-a070-4fb9-a144-a1ffe6ba4f48]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHFgWiUT {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHFgWiUT" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4736ebdc-aa79-4518-a2ee-408fe952dbd8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QHFgWiUT'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[181c8410-eab2-4e48-863e-3cc66ceecfd6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f7e16-aa3c-4697-8244-04b3a529c191]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ead9f-b10b-4c49-9b85-cbddac48198b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260]
Nov 22 16:33:23 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260] successful.
Nov 22 16:33:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[311318fb-d8af-443b-8934-841284d141f7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371c340-9f17-44a8-931b-6e43a8cb163d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)
Nov 22 16:33:23 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc6a25d-e7fd-4bcf-9239-bfdab90add8c]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:33:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHFgWiUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23566393962663166', 'path': '/dev/sdd'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566393962663166', 'path': '/dev/sdd'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-677097715',display_name='tempest-TestVolumeBootPattern-server-677097715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-677097715',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-2t06tcbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:33:17Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=c477e120-670d-471c-9f2c-4e2c9ad1154c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1f:03,bridge_name='br-int',has_traffic_filtering=True,id=3eb37077-2889-4e20-b3d8-78d28d24681b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb37077-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.objects.instance [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'pci_devices' on Instance uuid c477e120-670d-471c-9f2c-4e2c9ad1154c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:33:24 user nova-compute[75734]:   <uuid>c477e120-670d-471c-9f2c-4e2c9ad1154c</uuid>
Nov 22 16:33:24 user nova-compute[75734]:   <name>instance-00000030</name>
Nov 22 16:33:24 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:33:24 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:33:24 user nova-compute[75734]:   <metadata>
Nov 22 16:33:24 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:33:24 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:33:24 user nova-compute[75734]:       <nova:name>tempest-TestVolumeBootPattern-server-677097715</nova:name>
Nov 22 16:33:24 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:33:22</nova:creationTime>
Nov 22 16:33:24 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:33:24 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:33:24 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:33:24 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:33:24 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:33:24 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:33:24 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:33:24 user nova-compute[75734]:       <nova:owner>
Nov 22 16:33:24 user nova-compute[75734]:         <nova:user uuid="0aea0c396dc748bb8f8637981676ea72">tempest-TestVolumeBootPattern-318400595-project-member</nova:user>
Nov 22 16:33:24 user nova-compute[75734]:         <nova:project uuid="0532683a0b9b4d65b6c24a9fd2c6bf23">tempest-TestVolumeBootPattern-318400595</nova:project>
Nov 22 16:33:24 user nova-compute[75734]:       </nova:owner>
Nov 22 16:33:24 user nova-compute[75734]:       <nova:ports>
Nov 22 16:33:24 user nova-compute[75734]:         <nova:port uuid="3eb37077-2889-4e20-b3d8-78d28d24681b">
Nov 22 16:33:24 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 16:33:24 user nova-compute[75734]:         </nova:port>
Nov 22 16:33:24 user nova-compute[75734]:       </nova:ports>
Nov 22 16:33:24 user nova-compute[75734]:     </nova:instance>
Nov 22 16:33:24 user nova-compute[75734]:   </metadata>
Nov 22 16:33:24 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:33:24 user nova-compute[75734]:     <system>
Nov 22 16:33:24 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:33:24 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:33:24 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:33:24 user nova-compute[75734]:       <entry name="serial">c477e120-670d-471c-9f2c-4e2c9ad1154c</entry>
Nov 22 16:33:24 user nova-compute[75734]:       <entry name="uuid">c477e120-670d-471c-9f2c-4e2c9ad1154c</entry>
Nov 22 16:33:24 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:33:24 user nova-compute[75734]:     </system>
Nov 22 16:33:24 user nova-compute[75734]:   </sysinfo>
Nov 22 16:33:24 user nova-compute[75734]:   <os>
Nov 22 16:33:24 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:33:24 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:33:24 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:33:24 user nova-compute[75734]:   </os>
Nov 22 16:33:24 user nova-compute[75734]:   <features>
Nov 22 16:33:24 user nova-compute[75734]:     <acpi/>
Nov 22 16:33:24 user nova-compute[75734]:     <apic/>
Nov 22 16:33:24 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:33:24 user nova-compute[75734]:   </features>
Nov 22 16:33:24 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:33:24 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:33:24 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:33:24 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:33:24 user nova-compute[75734]:   </clock>
Nov 22 16:33:24 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:33:24 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:33:24 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:33:24 user nova-compute[75734]:   </cpu>
Nov 22 16:33:24 user nova-compute[75734]:   <devices>
Nov 22 16:33:24 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:33:24 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:33:24 user nova-compute[75734]:       <source dev="/dev/sdd"/>
Nov 22 16:33:24 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:33:24 user nova-compute[75734]:       <serial>ebb1f647-9058-4cbd-9f4a-9b8d2218a471</serial>
Nov 22 16:33:24 user nova-compute[75734]:     </disk>
Nov 22 16:33:24 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:33:24 user nova-compute[75734]:       <mac address="fa:16:3e:7d:1f:03"/>
Nov 22 16:33:24 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:33:24 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:33:24 user nova-compute[75734]:       <target dev="tap3eb37077-28"/>
Nov 22 16:33:24 user nova-compute[75734]:     </interface>
Nov 22 16:33:24 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:33:24 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/c477e120-670d-471c-9f2c-4e2c9ad1154c/console.log" append="off"/>
Nov 22 16:33:24 user nova-compute[75734]:     </serial>
Nov 22 16:33:24 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:33:24 user nova-compute[75734]:     <video>
Nov 22 16:33:24 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:33:24 user nova-compute[75734]:     </video>
Nov 22 16:33:24 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:33:24 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:33:24 user nova-compute[75734]:     </rng>
Nov 22 16:33:24 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:33:24 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:33:24 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:33:24 user nova-compute[75734]:     </memballoon>
Nov 22 16:33:24 user nova-compute[75734]:   </devices>
Nov 22 16:33:24 user nova-compute[75734]: </domain>
Nov 22 16:33:24 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-677097715',display_name='tempest-TestVolumeBootPattern-server-677097715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-677097715',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-2t06tcbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:33:17Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=c477e120-670d-471c-9f2c-4e2c9ad1154c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1f:03,bridge_name='br-int',has_traffic_filtering=True,id=3eb37077-2889-4e20-b3d8-78d28d24681b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb37077-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG os_vif [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1f:03,bridge_name='br-int',has_traffic_filtering=True,id=3eb37077-2889-4e20-b3d8-78d28d24681b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb37077-28') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a4f8f09-7e33-5b51-b36e-c4beb514c6b3', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eb37077-28, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eb37077-28, col_values=(('qos', UUID('aab1e330-60b5-4a2c-88f7-95bbb7db455f')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eb37077-28, col_values=(('external_ids', {'iface-id': '3eb37077-2889-4e20-b3d8-78d28d24681b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:1f:03', 'vm-uuid': 'c477e120-670d-471c-9f2c-4e2c9ad1154c'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:24 user nova-compute[75734]: INFO os_vif [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1f:03,bridge_name='br-int',has_traffic_filtering=True,id=3eb37077-2889-4e20-b3d8-78d28d24681b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb37077-28')
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:33:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] No VIF found with MAC fa:16:3e:7d:1f:03, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-4b1c3ba1-9fab-4e4f-b069-2febfb35b879 req-6651adda-0342-461b-acf6-87c1b8931727 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4b1c3ba1-9fab-4e4f-b069-2febfb35b879 req-6651adda-0342-461b-acf6-87c1b8931727 service nova] Acquiring lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4b1c3ba1-9fab-4e4f-b069-2febfb35b879 req-6651adda-0342-461b-acf6-87c1b8931727 service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4b1c3ba1-9fab-4e4f-b069-2febfb35b879 req-6651adda-0342-461b-acf6-87c1b8931727 service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-4b1c3ba1-9fab-4e4f-b069-2febfb35b879 req-6651adda-0342-461b-acf6-87c1b8931727 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] No waiting events found dispatching network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:33:25 user nova-compute[75734]: WARNING nova.compute.manager [req-4b1c3ba1-9fab-4e4f-b069-2febfb35b879 req-6651adda-0342-461b-acf6-87c1b8931727 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received unexpected event network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b for instance with vm_state building and task_state spawning.
Nov 22 16:33:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:33:27 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Instance spawned successfully.
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:33:27 user nova-compute[75734]: INFO nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-cd4d4b3c-0e7f-4018-9e1f-0c38b55fbb1f req-464ff4db-5ddf-4700-904c-ddcd7fd1c96c service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cd4d4b3c-0e7f-4018-9e1f-0c38b55fbb1f req-464ff4db-5ddf-4700-904c-ddcd7fd1c96c service nova] Acquiring lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cd4d4b3c-0e7f-4018-9e1f-0c38b55fbb1f req-464ff4db-5ddf-4700-904c-ddcd7fd1c96c service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cd4d4b3c-0e7f-4018-9e1f-0c38b55fbb1f req-464ff4db-5ddf-4700-904c-ddcd7fd1c96c service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:27 user nova-compute[75734]: DEBUG nova.compute.manager [req-cd4d4b3c-0e7f-4018-9e1f-0c38b55fbb1f req-464ff4db-5ddf-4700-904c-ddcd7fd1c96c service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] No waiting events found dispatching network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:33:27 user nova-compute[75734]: WARNING nova.compute.manager [req-cd4d4b3c-0e7f-4018-9e1f-0c38b55fbb1f req-464ff4db-5ddf-4700-904c-ddcd7fd1c96c service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received unexpected event network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b for instance with vm_state building and task_state spawning.
Nov 22 16:33:27 user nova-compute[75734]: INFO nova.compute.manager [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Took 11.75 seconds to build instance.
Nov 22 16:33:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-000a806d-2722-472a-8649-778a7b716e5d tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.954s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:33:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:33:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:33:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:33:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:33:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:36 user nova-compute[75734]: INFO nova.compute.manager [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Detaching volume 9d60cbe1-2e0a-4981-a160-8209ea6c10c6
Nov 22 16:33:36 user nova-compute[75734]: INFO nova.virt.block_device [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Attempting to driver detach volume 9d60cbe1-2e0a-4981-a160-8209ea6c10c6 from mountpoint /dev/vdb
Nov 22 16:33:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Attempting to detach device vdb from instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:33:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:33:36 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:33:36 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:33:36 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:33:36 user nova-compute[75734]:   <serial>9d60cbe1-2e0a-4981-a160-8209ea6c10c6</serial>
Nov 22 16:33:36 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:33:36 user nova-compute[75734]: </disk>
Nov 22 16:33:36 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:33:36 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully detached device vdb from instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 from the persistent domain config.
Nov 22 16:33:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:33:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:33:36 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:33:36 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:33:36 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:33:36 user nova-compute[75734]:   <serial>9d60cbe1-2e0a-4981-a160-8209ea6c10c6</serial>
Nov 22 16:33:36 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:33:36 user nova-compute[75734]: </disk>
Nov 22 16:33:36 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:33:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:33:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:57 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 is timed out.
Nov 22 16:33:57 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully detached device vdb from instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 from the live domain config.
Nov 22 16:33:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibEzjdts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:33:57 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a2825e-1a4d-4918-a05c-df0a291ad590]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:33:57 user nova-compute[75734]: No targets found.
Nov 22 16:33:57 user nova-compute[75734]: iSNS:
Nov 22 16:33:57 user nova-compute[75734]: No targets found.
Nov 22 16:33:57 user nova-compute[75734]: STATIC:
Nov 22 16:33:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950
Nov 22 16:33:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:33:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:33:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471
Nov 22 16:33:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:33:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:33:57 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6
Nov 22 16:33:57 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:33:57 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:33:57 user nova-compute[75734]: FIRMWARE:
Nov 22 16:33:57 user nova-compute[75734]: No targets found.
Nov 22 16:33:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:33:57 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:33:57 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[089937b6-3cfb-4026-bcdc-75e6d781d661]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[604459e7-cdec-4352-add5-ab90934accc3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:33:57 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:33:57 user nova-compute[75734]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)
Nov 22 16:33:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:33:57 user nova-compute[75734]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 (non-flash)
Nov 22 16:33:57 user nova-compute[75734]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)
Nov 22 16:33:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc3d4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b7e7f-4b33-4398-88f5-b1182bdfbb25]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb9db57-b5d4-416f-ba36-d88341e648e6]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[00182a6e-8758-4c99-9a1b-54de05e5e4b6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[04441f10-f656-4851-beb4-bc2e523ee131]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc2982e-2a3a-4c6a-bb36-ddaade812159]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a004f8b-fc18-46a7-9b19-d0614fe33433]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260]
Nov 22 16:33:57 user nova-compute[75734]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6, portal: 172.16.0.220,3260] successful.
Nov 22 16:33:57 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d60cbe1-2e0a-4981-a160-8209ea6c10c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe14f6-d774-4c28-b723-4a99f442b063]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== disconnect_volume: return (297ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:33:57 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:33:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:33:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-99d0919e-538c-4963-899e-04f8f4f1a5a0 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.802s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-66dfe032-c63a-4840-8880-6af23152a0a3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-66dfe032-c63a-4840-8880-6af23152a0a3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:58 user nova-compute[75734]: DEBUG nova.compute.manager [None req-66dfe032-c63a-4840-8880-6af23152a0a3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:33:58 user nova-compute[75734]: DEBUG nova.compute.manager [None req-66dfe032-c63a-4840-8880-6af23152a0a3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75734) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 22 16:33:58 user nova-compute[75734]: DEBUG nova.objects.instance [None req-66dfe032-c63a-4840-8880-6af23152a0a3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-fd8bfe87-d11b-41e9-8285-2f4af6269f11 req-ba3cb7d1-ee92-40fa-be16-93a59cdfa38c service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fd8bfe87-d11b-41e9-8285-2f4af6269f11 req-ba3cb7d1-ee92-40fa-be16-93a59cdfa38c service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fd8bfe87-d11b-41e9-8285-2f4af6269f11 req-ba3cb7d1-ee92-40fa-be16-93a59cdfa38c service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-fd8bfe87-d11b-41e9-8285-2f4af6269f11 req-ba3cb7d1-ee92-40fa-be16-93a59cdfa38c service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG nova.compute.manager [req-fd8bfe87-d11b-41e9-8285-2f4af6269f11 req-ba3cb7d1-ee92-40fa-be16-93a59cdfa38c service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:33:59 user nova-compute[75734]: WARNING nova.compute.manager [req-fd8bfe87-d11b-41e9-8285-2f4af6269f11 req-ba3cb7d1-ee92-40fa-be16-93a59cdfa38c service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state active and task_state powering-off.
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance destroyed successfully.
Nov 22 16:33:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-66dfe032-c63a-4840-8880-6af23152a0a3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:33:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-66dfe032-c63a-4840-8880-6af23152a0a3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.846s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:34:01 user nova-compute[75734]: WARNING nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state None.
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:34:01 user nova-compute[75734]: WARNING nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state None.
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:34:01 user nova-compute[75734]: WARNING nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state None.
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:34:01 user nova-compute[75734]: WARNING nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state None.
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:01 user nova-compute[75734]: DEBUG nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:34:01 user nova-compute[75734]: WARNING nova.compute.manager [req-1418187b-7e4b-48fa-9c54-1ca39ccb3ff8 req-14e6090a-1ec3-46ae-ac13-fe8bc8ef4969 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state None.
Nov 22 16:34:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:34:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:34:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:34:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=24.97815704345703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 81d0af64-feba-4492-a013-4e9954e6f8cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance c477e120-670d-471c-9f2c-4e2c9ad1154c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:34:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:34:17 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:17 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:34:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:34:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:34:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:34:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:34:21 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:34:21 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:34:22 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:34:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:34:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:24 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:28 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:34:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:34:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:34:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:34:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:34:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:34:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:34:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:34:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-changed-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:35:07 user nova-compute[75734]: DEBUG nova.compute.manager [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Refreshing instance network info cache due to event network-changed-3eb37077-2889-4e20-b3d8-78d28d24681b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:35:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] Acquiring lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:35:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] Acquired lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:35:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Refreshing network info cache for port 3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updated VIF entry in instance network info cache for port 3eb37077-2889-4e20-b3d8-78d28d24681b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG nova.network.neutron [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updating instance_info_cache with network_info: [{"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1b1ee185-75dc-4726-8643-8fee36dd6125 req-c150e019-a46b-4c84-89c3-273ca1e813b3 service nova] Releasing lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "c477e120-670d-471c-9f2c-4e2c9ad1154c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:08 user nova-compute[75734]: INFO nova.compute.manager [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Terminating instance
Nov 22 16:35:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Instance destroyed successfully.
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.objects.instance [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'resources' on Instance uuid c477e120-670d-471c-9f2c-4e2c9ad1154c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-677097715',display_name='tempest-TestVolumeBootPattern-server-677097715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-677097715',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-2t06tcbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:33:28Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=c477e120-670d-471c-9f2c-4e2c9ad1154c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:1f:03,bridge_name='br-int',has_traffic_filtering=True,id=3eb37077-2889-4e20-b3d8-78d28d24681b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb37077-28') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_vif [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:1f:03,bridge_name='br-int',has_traffic_filtering=True,id=3eb37077-2889-4e20-b3d8-78d28d24681b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb37077-28') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eb37077-28, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aab1e330-60b5-4a2c-88f7-95bbb7db455f) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:09 user nova-compute[75734]: INFO os_vif [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:1f:03,bridge_name='br-int',has_traffic_filtering=True,id=3eb37077-2889-4e20-b3d8-78d28d24681b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb37077-28')
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHFgWiUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:35:09 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e1c30-f067-4ada-a12d-f7a98073a4b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:35:09 user nova-compute[75734]: No targets found.
Nov 22 16:35:09 user nova-compute[75734]: iSNS:
Nov 22 16:35:09 user nova-compute[75734]: No targets found.
Nov 22 16:35:09 user nova-compute[75734]: STATIC:
Nov 22 16:35:09 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950
Nov 22 16:35:09 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:35:09 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:35:09 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471
Nov 22 16:35:09 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:35:09 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:35:09 user nova-compute[75734]: FIRMWARE:
Nov 22 16:35:09 user nova-compute[75734]: No targets found.
Nov 22 16:35:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:35:09 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:35:09 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[397e7e37-70f7-4c26-b449-03ca5aec3e3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[708d1418-7f5e-4397-b142-c11a056bb858]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:35:09 user nova-compute[75734]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)
Nov 22 16:35:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:35:09 user nova-compute[75734]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 (non-flash)
Nov 22 16:35:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc6927a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471'): ({'sdd'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Removing single pathed devices sdd {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[733dec28-0b22-4c84-9b48-597d6089818f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd07aef4-af3f-4788-a93b-b9e85f898e6d]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flushing IO for device /dev/sdd {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98cfc72-7291-40af-8fd8-999b1e79344b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27e00f7-d078-4f6a-b801-2edb5d1718fb]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] SCSI volumes sdd have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23566393962663166', '/dev/disk/by-id/scsi-1SCST_BIO72aefe65-5f99bf1f31a2d1fa', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_72aefe65') {{(pid=86452) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 16:35:09 user nova-compute[75734]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23566393962663166
Nov 22 16:35:09 user nova-compute[75734]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO72aefe65-5f99bf1f31a2d1fa
Nov 22 16:35:09 user nova-compute[75734]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_72aefe65
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f42c1c0-af98-431e-9c58-95f58c08169a]: (4, None) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[343301c2-da8a-4a05-a8a0-d319cfb3b607]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5ebe40-aee2-498a-8a46-c3025cff4f55]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260]
Nov 22 16:35:09 user nova-compute[75734]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471, portal: 172.16.0.220,3260] successful.
Nov 22 16:35:09 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-changed-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Refreshing instance network info cache due to event network-changed-3eb37077-2889-4e20-b3d8-78d28d24681b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Acquiring lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Acquired lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.network.neutron [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Refreshing network info cache for port 3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebb1f647-9058-4cbd-9f4a-9b8d2218a471 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e52b9c-8b15-4c71-8663-42c84e30b09a]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== disconnect_volume: return (328ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:35:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Deleting instance files /opt/stack/data/nova/instances/c477e120-670d-471c-9f2c-4e2c9ad1154c_del
Nov 22 16:35:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Deletion of /opt/stack/data/nova/instances/c477e120-670d-471c-9f2c-4e2c9ad1154c_del complete
Nov 22 16:35:09 user nova-compute[75734]: INFO nova.compute.manager [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 22 16:35:09 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:35:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.network.neutron [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updated VIF entry in instance network info cache for port 3eb37077-2889-4e20-b3d8-78d28d24681b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.network.neutron [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updating instance_info_cache with network_info: [{"id": "3eb37077-2889-4e20-b3d8-78d28d24681b", "address": "fa:16:3e:7d:1f:03", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb37077-28", "ovs_interfaceid": "3eb37077-2889-4e20-b3d8-78d28d24681b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Releasing lock "refresh_cache-c477e120-670d-471c-9f2c-4e2c9ad1154c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-vif-unplugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Acquiring lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] No waiting events found dispatching network-vif-unplugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-vif-unplugged-3eb37077-2889-4e20-b3d8-78d28d24681b for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Acquiring lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] No waiting events found dispatching network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:35:10 user nova-compute[75734]: WARNING nova.compute.manager [req-1d2bfc82-5cee-43d5-bc64-aae37df225d4 req-019c39bc-140e-4c12-8245-ce74cb0afb35 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received unexpected event network-vif-plugged-3eb37077-2889-4e20-b3d8-78d28d24681b for instance with vm_state active and task_state deleting.
Nov 22 16:35:10 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:35:10 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Took 0.60 seconds to deallocate network for instance.
Nov 22 16:35:11 user nova-compute[75734]: INFO nova.compute.manager [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Took 0.85 seconds to detach 1 volumes for instance.
Nov 22 16:35:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:11 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:35:11 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:35:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:11 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Deleted allocations for instance c477e120-670d-471c-9f2c-4e2c9ad1154c
Nov 22 16:35:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-c26aac2f-d3c1-4cc0-be78-774a308f2198 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "c477e120-670d-471c-9f2c-4e2c9ad1154c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.967s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-ec9e130c-5fa2-4e34-996e-15ae8a5b36a9 req-6ecf3288-199f-4457-b2f1-6ed14bf60468 service nova] [instance: c477e120-670d-471c-9f2c-4e2c9ad1154c] Received event network-vif-deleted-3eb37077-2889-4e20-b3d8-78d28d24681b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:35:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:35:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=24.97722625732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 81d0af64-feba-4492-a013-4e9954e6f8cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:35:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:35:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:20 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:22 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:22 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:35:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:35:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:35:22 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:35:23 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating instance_info_cache with network_info: [{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:35:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:35:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:35:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:35:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:49 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:35:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:35:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:35:49 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:49 user nova-compute[75734]: DEBUG nova.objects.base [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:35:50 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance destroyed successfully.
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'resources' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.base [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG os_vif [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d20b284-9b, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c19bc1f-dd96-4496-b346-b9ee1bdd17bc) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:50 user nova-compute[75734]: INFO os_vif [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b')
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Start _get_guest_xml network_info=[{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'numa_topology' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.base [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:35:50 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:35:50 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.base [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'pci_devices' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.base [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:35:50 user nova-compute[75734]:   <uuid>f1ca4c7a-d634-4f34-af24-0e8d23ee3319</uuid>
Nov 22 16:35:50 user nova-compute[75734]:   <name>instance-0000002d</name>
Nov 22 16:35:50 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:35:50 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:35:50 user nova-compute[75734]:   <metadata>
Nov 22 16:35:50 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:35:50 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:35:50 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeTestJSON-server-10626121</nova:name>
Nov 22 16:35:50 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:35:50</nova:creationTime>
Nov 22 16:35:50 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:35:50 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:35:50 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:35:50 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:35:50 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:35:50 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:35:50 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:35:50 user nova-compute[75734]:       <nova:owner>
Nov 22 16:35:50 user nova-compute[75734]:         <nova:user uuid="0f7b8124d8ef489496bcb5bab0e28710">tempest-AttachVolumeTestJSON-146842854-project-member</nova:user>
Nov 22 16:35:50 user nova-compute[75734]:         <nova:project uuid="3d22409cfae24b46923c4e5bc6639fdb">tempest-AttachVolumeTestJSON-146842854</nova:project>
Nov 22 16:35:50 user nova-compute[75734]:       </nova:owner>
Nov 22 16:35:50 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:35:50 user nova-compute[75734]:       <nova:ports>
Nov 22 16:35:50 user nova-compute[75734]:         <nova:port uuid="1d20b284-9bd0-4029-acd9-5ff0b5f788b7">
Nov 22 16:35:50 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:35:50 user nova-compute[75734]:         </nova:port>
Nov 22 16:35:50 user nova-compute[75734]:       </nova:ports>
Nov 22 16:35:50 user nova-compute[75734]:     </nova:instance>
Nov 22 16:35:50 user nova-compute[75734]:   </metadata>
Nov 22 16:35:50 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:35:50 user nova-compute[75734]:     <system>
Nov 22 16:35:50 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:35:50 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:35:50 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:35:50 user nova-compute[75734]:       <entry name="serial">f1ca4c7a-d634-4f34-af24-0e8d23ee3319</entry>
Nov 22 16:35:50 user nova-compute[75734]:       <entry name="uuid">f1ca4c7a-d634-4f34-af24-0e8d23ee3319</entry>
Nov 22 16:35:50 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:35:50 user nova-compute[75734]:     </system>
Nov 22 16:35:50 user nova-compute[75734]:   </sysinfo>
Nov 22 16:35:50 user nova-compute[75734]:   <os>
Nov 22 16:35:50 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:35:50 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:35:50 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:35:50 user nova-compute[75734]:   </os>
Nov 22 16:35:50 user nova-compute[75734]:   <features>
Nov 22 16:35:50 user nova-compute[75734]:     <acpi/>
Nov 22 16:35:50 user nova-compute[75734]:     <apic/>
Nov 22 16:35:50 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:35:50 user nova-compute[75734]:   </features>
Nov 22 16:35:50 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:35:50 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:35:50 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:35:50 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:35:50 user nova-compute[75734]:   </clock>
Nov 22 16:35:50 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:35:50 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:35:50 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:35:50 user nova-compute[75734]:   </cpu>
Nov 22 16:35:50 user nova-compute[75734]:   <devices>
Nov 22 16:35:50 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:35:50 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:35:50 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk"/>
Nov 22 16:35:50 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:35:50 user nova-compute[75734]:     </disk>
Nov 22 16:35:50 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:35:50 user nova-compute[75734]:       <mac address="fa:16:3e:04:2d:65"/>
Nov 22 16:35:50 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:35:50 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:35:50 user nova-compute[75734]:       <target dev="tap1d20b284-9b"/>
Nov 22 16:35:50 user nova-compute[75734]:     </interface>
Nov 22 16:35:50 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:35:50 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/console.log" append="off"/>
Nov 22 16:35:50 user nova-compute[75734]:     </serial>
Nov 22 16:35:50 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:35:50 user nova-compute[75734]:     <video>
Nov 22 16:35:50 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:35:50 user nova-compute[75734]:     </video>
Nov 22 16:35:50 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:35:50 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:35:50 user nova-compute[75734]:     </rng>
Nov 22 16:35:50 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:35:50 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:35:50 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:35:50 user nova-compute[75734]:     </memballoon>
Nov 22 16:35:50 user nova-compute[75734]:   </devices>
Nov 22 16:35:50 user nova-compute[75734]: </domain>
Nov 22 16:35:50 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG nova.objects.base [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:35:50 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Cannot resize image /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'migration_context' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG nova.objects.base [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Object Instance<f1ca4c7a-d634-4f34-af24-0e8d23ee3319> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG os_vif [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60cf23d9-9f4b-5736-88f1-d4aab1552b64', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d20b284-9b, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d20b284-9b, col_values=(('qos', UUID('b18ead21-1c73-45d3-98c4-6555eb1b3968')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d20b284-9b, col_values=(('external_ids', {'iface-id': '1d20b284-9bd0-4029-acd9-5ff0b5f788b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:2d:65', 'vm-uuid': 'f1ca4c7a-d634-4f34-af24-0e8d23ee3319'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:35:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:51 user nova-compute[75734]: INFO os_vif [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b')
Nov 22 16:35:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-cb6d84a2-ce71-480d-a4b3-02ab2e3149c2 req-f959c998-1473-4300-8c44-cc3132492a79 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:35:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cb6d84a2-ce71-480d-a4b3-02ab2e3149c2 req-f959c998-1473-4300-8c44-cc3132492a79 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cb6d84a2-ce71-480d-a4b3-02ab2e3149c2 req-f959c998-1473-4300-8c44-cc3132492a79 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-cb6d84a2-ce71-480d-a4b3-02ab2e3149c2 req-f959c998-1473-4300-8c44-cc3132492a79 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:52 user nova-compute[75734]: DEBUG nova.compute.manager [req-cb6d84a2-ce71-480d-a4b3-02ab2e3149c2 req-f959c998-1473-4300-8c44-cc3132492a79 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:35:52 user nova-compute[75734]: WARNING nova.compute.manager [req-cb6d84a2-ce71-480d-a4b3-02ab2e3149c2 req-f959c998-1473-4300-8c44-cc3132492a79 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state stopped and task_state powering-on.
Nov 22 16:35:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:35:54 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance rebooted successfully.
Nov 22 16:35:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-8357ebfb-2478-42fb-9747-4a3ff63c2bd6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:35:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-c80207b3-f97a-402c-bc1f-1a585dc0b88d req-acd26bb9-cfdb-4137-8a05-a4fb67d62f48 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:35:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c80207b3-f97a-402c-bc1f-1a585dc0b88d req-acd26bb9-cfdb-4137-8a05-a4fb67d62f48 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:35:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c80207b3-f97a-402c-bc1f-1a585dc0b88d req-acd26bb9-cfdb-4137-8a05-a4fb67d62f48 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:35:54 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c80207b3-f97a-402c-bc1f-1a585dc0b88d req-acd26bb9-cfdb-4137-8a05-a4fb67d62f48 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:35:54 user nova-compute[75734]: DEBUG nova.compute.manager [req-c80207b3-f97a-402c-bc1f-1a585dc0b88d req-acd26bb9-cfdb-4137-8a05-a4fb67d62f48 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:35:54 user nova-compute[75734]: WARNING nova.compute.manager [req-c80207b3-f97a-402c-bc1f-1a585dc0b88d req-acd26bb9-cfdb-4137-8a05-a4fb67d62f48 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state active and task_state None.
Nov 22 16:35:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:35:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-changed-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Refreshing instance network info cache due to event network-changed-e8c92fb1-c52f-4414-ae07-c352be87310b. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] Acquiring lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] Acquired lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.network.neutron [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Refreshing network info cache for port e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:06 user nova-compute[75734]: INFO nova.compute.manager [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Terminating instance
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.compute.manager [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-2af5d292-084d-4356-aae3-08dcbcef2c8f req-6c5d5163-e813-44b4-9a58-c5be4462598c service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-unplugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2af5d292-084d-4356-aae3-08dcbcef2c8f req-6c5d5163-e813-44b4-9a58-c5be4462598c service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2af5d292-084d-4356-aae3-08dcbcef2c8f req-6c5d5163-e813-44b4-9a58-c5be4462598c service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2af5d292-084d-4356-aae3-08dcbcef2c8f req-6c5d5163-e813-44b4-9a58-c5be4462598c service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-2af5d292-084d-4356-aae3-08dcbcef2c8f req-6c5d5163-e813-44b4-9a58-c5be4462598c service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-unplugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.compute.manager [req-2af5d292-084d-4356-aae3-08dcbcef2c8f req-6c5d5163-e813-44b4-9a58-c5be4462598c service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-unplugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:36:06 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Instance destroyed successfully.
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.objects.instance [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lazy-loading 'resources' on Instance uuid 81d0af64-feba-4492-a013-4e9954e6f8cb {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-389227585',display_name='tempest-TestVolumeBootPattern-server-389227585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-389227585',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpeInf60VY+Bz4ef+VhhHMASOI9LiG3fGgVHqeGW0xY8o/xGQpZ/PiMk9Y1PVIMuJ8zJKFsBuRtKHuWm+k7/806jZCv30f/xN24q1rvpP19mWCAlB9BPm5F4COsZ5l5XQ==',key_name='tempest-TestVolumeBootPattern-992710202',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:31:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0532683a0b9b4d65b6c24a9fd2c6bf23',ramdisk_id='',reservation_id='r-h0ql83of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-318400595',owner_user_name='tempest-TestVolumeBootPattern-318400595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:31:29Z,user_data=None,user_id='0aea0c396dc748bb8f8637981676ea72',uuid=81d0af64-feba-4492-a013-4e9954e6f8cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converting VIF {"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a3:41,bridge_name='br-int',has_traffic_filtering=True,id=e8c92fb1-c52f-4414-ae07-c352be87310b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c92fb1-c5') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG os_vif [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a3:41,bridge_name='br-int',has_traffic_filtering=True,id=e8c92fb1-c52f-4414-ae07-c352be87310b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c92fb1-c5') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c92fb1-c5, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50653f54-3cae-48d1-818d-69f11ff2409f) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:06 user nova-compute[75734]: INFO os_vif [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a3:41,bridge_name='br-int',has_traffic_filtering=True,id=e8c92fb1-c52f-4414-ae07-c352be87310b,network=Network(d7cd27ad-c88d-4c99-a029-5879b9ccce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c92fb1-c5')
Nov 22 16:36:06 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFmxnElh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:36:06 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:36:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:36:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b94055-eaff-46bc-88af-784f523bf65a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:36:07 user nova-compute[75734]: No targets found.
Nov 22 16:36:07 user nova-compute[75734]: iSNS:
Nov 22 16:36:07 user nova-compute[75734]: No targets found.
Nov 22 16:36:07 user nova-compute[75734]: STATIC:
Nov 22 16:36:07 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950
Nov 22 16:36:07 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:36:07 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:36:07 user nova-compute[75734]: FIRMWARE:
Nov 22 16:36:07 user nova-compute[75734]: No targets found.
Nov 22 16:36:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:36:07 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:36:07 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da05388-77ae-4d49-afa4-ceb8ff538866]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ba5fe-8d8a-4513-bbfc-6073a92b63b6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:36:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 (non-flash)
Nov 22 16:36:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac7f3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f9aad-c82b-434c-97cf-2e0da4e2f9e6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updated VIF entry in instance network info cache for port e8c92fb1-c52f-4414-ae07-c352be87310b. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG nova.network.neutron [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating instance_info_cache with network_info: [{"id": "e8c92fb1-c52f-4414-ae07-c352be87310b", "address": "fa:16:3e:2e:a3:41", "network": {"id": "d7cd27ad-c88d-4c99-a029-5879b9ccce83", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1923119645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0532683a0b9b4d65b6c24a9fd2c6bf23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c92fb1-c5", "ovs_interfaceid": "e8c92fb1-c52f-4414-ae07-c352be87310b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da522fe-ea95-4b07-8dc5-7d5db0d2a777]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-80949dcf-7602-43e8-b80b-116e111c142e req-9e1645ef-3f07-4878-aea9-db35848ea817 service nova] Releasing lock "refresh_cache-81d0af64-feba-4492-a013-4e9954e6f8cb" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f271befb-f9af-4f2a-8c32-929934bbb329]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a57b3e7-7887-413c-b41c-cec40c3e580c]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO98065566-e4fa37664be052cd', '/dev/disk/by-id/scsi-26534666133373636', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_98065566') {{(pid=86452) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9975a1e-2e61-45de-9185-82bbb42707f8]: (4, None) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d180c-761b-497a-9574-714917bca86d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[935ce509-1683-4a7a-afc6-2d43365e47cd]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260]
Nov 22 16:36:07 user nova-compute[75734]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950, portal: 172.16.0.220,3260] successful.
Nov 22 16:36:07 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3928b7-cb19-4c30-ab14-2215346c9950 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[76311da5-dcf2-4756-8ae7-bda1fe5ded38]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] <== disconnect_volume: return (360ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:36:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Deleting instance files /opt/stack/data/nova/instances/81d0af64-feba-4492-a013-4e9954e6f8cb_del
Nov 22 16:36:07 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Deletion of /opt/stack/data/nova/instances/81d0af64-feba-4492-a013-4e9954e6f8cb_del complete
Nov 22 16:36:07 user nova-compute[75734]: INFO nova.compute.manager [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 22 16:36:07 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:36:08 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Took 0.74 seconds to deallocate network for instance.
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:36:08 user nova-compute[75734]: WARNING nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received unexpected event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with vm_state active and task_state deleting.
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:36:08 user nova-compute[75734]: WARNING nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received unexpected event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with vm_state active and task_state deleting.
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:36:08 user nova-compute[75734]: WARNING nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received unexpected event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with vm_state active and task_state deleting.
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-unplugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-unplugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-unplugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Acquiring lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] No waiting events found dispatching network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:36:08 user nova-compute[75734]: WARNING nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received unexpected event network-vif-plugged-e8c92fb1-c52f-4414-ae07-c352be87310b for instance with vm_state active and task_state deleting.
Nov 22 16:36:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-6029aec0-e4e4-468c-bb37-50926ef640e2 req-070814ee-2fe2-41a8-a032-740b7f6076ed service nova] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Received event network-vif-deleted-e8c92fb1-c52f-4414-ae07-c352be87310b {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:36:08 user nova-compute[75734]: INFO nova.compute.manager [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] [instance: 81d0af64-feba-4492-a013-4e9954e6f8cb] Took 0.77 seconds to detach 1 volumes for instance.
Nov 22 16:36:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:09 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:36:09 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:36:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:09 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Deleted allocations for instance 81d0af64-feba-4492-a013-4e9954e6f8cb
Nov 22 16:36:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-e9c2b744-2d56-465e-a3df-059c7ff88525 tempest-TestVolumeBootPattern-318400595 tempest-TestVolumeBootPattern-318400595-project-member] Lock "81d0af64-feba-4492-a013-4e9954e6f8cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.234s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:36:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:36:17 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:36:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=24.975467681884766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:36:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:36:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:20 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:36:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:22 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:36:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:36:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:36:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:36:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:36:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:36:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:36:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:36:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:36:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:36:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:36:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:36:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:36:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:36:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:36:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:36:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:36:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:36:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:36:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5019 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:37:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:37:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:37:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:37:18 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:37:18 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:37:18 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=24.966400146484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:37:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:37:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:20 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:37:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:24 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:37:25 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:37:26 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [{"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:37:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-f1ca4c7a-d634-4f34-af24-0e8d23ee3319" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:37:26 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:37:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:37:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:28 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:33 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:37:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:37:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:37:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:37:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:37:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:37:40 user nova-compute[75734]: INFO nova.compute.manager [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Terminating instance
Nov 22 16:37:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-3aa3b14c-7635-4518-88e7-ee8ad6373dd1 req-c7ac0ec1-ee5e-4b8d-a147-4ef4ea8fd89a service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3aa3b14c-7635-4518-88e7-ee8ad6373dd1 req-c7ac0ec1-ee5e-4b8d-a147-4ef4ea8fd89a service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3aa3b14c-7635-4518-88e7-ee8ad6373dd1 req-c7ac0ec1-ee5e-4b8d-a147-4ef4ea8fd89a service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3aa3b14c-7635-4518-88e7-ee8ad6373dd1 req-c7ac0ec1-ee5e-4b8d-a147-4ef4ea8fd89a service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-3aa3b14c-7635-4518-88e7-ee8ad6373dd1 req-c7ac0ec1-ee5e-4b8d-a147-4ef4ea8fd89a service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.compute.manager [req-3aa3b14c-7635-4518-88e7-ee8ad6373dd1 req-c7ac0ec1-ee5e-4b8d-a147-4ef4ea8fd89a service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-unplugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Instance destroyed successfully.
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.objects.instance [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'resources' on Instance uuid f1ca4c7a-d634-4f34-af24-0e8d23ee3319 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10626121',display_name='tempest-AttachVolumeTestJSON-server-10626121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10626121',id=45,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWBH2K/mEWrLmz9GGBd7qbDxEIx0jOUufgi66FWCc4ndWFnD7ZeJYQJgx47PNI0HDBtX9IB3rMF66MmdDz0EYYKpRykbRMyqz5TpWC+5DSnJStGY8Co3iXb5drMCF6TUw==',key_name='tempest-keypair-247934565',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-wv6t7hf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=f1ca4c7a-d634-4f34-af24-0e8d23ee3319,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "address": "fa:16:3e:04:2d:65", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d20b284-9b", "ovs_interfaceid": "1d20b284-9bd0-4029-acd9-5ff0b5f788b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG os_vif [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d20b284-9b, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b18ead21-1c73-45d3-98c4-6555eb1b3968) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:41 user nova-compute[75734]: INFO os_vif [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=1d20b284-9bd0-4029-acd9-5ff0b5f788b7,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d20b284-9b')
Nov 22 16:37:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Deleting instance files /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319_del
Nov 22 16:37:41 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Deletion of /opt/stack/data/nova/instances/f1ca4c7a-d634-4f34-af24-0e8d23ee3319_del complete
Nov 22 16:37:41 user nova-compute[75734]: INFO nova.compute.manager [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 16:37:41 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:37:41 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:37:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:42 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:37:42 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Took 0.86 seconds to deallocate network for instance.
Nov 22 16:37:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:37:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:37:42 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:37:42 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:37:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:37:42 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Deleted allocations for instance f1ca4c7a-d634-4f34-af24-0e8d23ee3319
Nov 22 16:37:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-3fad483f-d546-4357-9af4-69e2fd36afe3 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:37:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-900f1cd0-b242-4bdf-a9a5-e7f140ba387b req-b649e89c-dcf6-429b-94e6-3d596ec4d8b2 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:37:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-900f1cd0-b242-4bdf-a9a5-e7f140ba387b req-b649e89c-dcf6-429b-94e6-3d596ec4d8b2 service nova] Acquiring lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:37:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-900f1cd0-b242-4bdf-a9a5-e7f140ba387b req-b649e89c-dcf6-429b-94e6-3d596ec4d8b2 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:37:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-900f1cd0-b242-4bdf-a9a5-e7f140ba387b req-b649e89c-dcf6-429b-94e6-3d596ec4d8b2 service nova] Lock "f1ca4c7a-d634-4f34-af24-0e8d23ee3319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:37:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-900f1cd0-b242-4bdf-a9a5-e7f140ba387b req-b649e89c-dcf6-429b-94e6-3d596ec4d8b2 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] No waiting events found dispatching network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:37:43 user nova-compute[75734]: WARNING nova.compute.manager [req-900f1cd0-b242-4bdf-a9a5-e7f140ba387b req-b649e89c-dcf6-429b-94e6-3d596ec4d8b2 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received unexpected event network-vif-plugged-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 for instance with vm_state deleted and task_state None.
Nov 22 16:37:43 user nova-compute[75734]: DEBUG nova.compute.manager [req-900f1cd0-b242-4bdf-a9a5-e7f140ba387b req-b649e89c-dcf6-429b-94e6-3d596ec4d8b2 service nova] [instance: f1ca4c7a-d634-4f34-af24-0e8d23ee3319] Received event network-vif-deleted-1d20b284-9bd0-4029-acd9-5ff0b5f788b7 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:37:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:37:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:37:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:37:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:37:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:38:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:18 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:38:19 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:38:19 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:38:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9247MB free_disk=24.993946075439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:38:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:38:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:38:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:38:29 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:38:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:34 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:38:35 user nova-compute[75734]: INFO nova.compute.claims [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Claim successful on node user
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:38:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.policy [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f7b8124d8ef489496bcb5bab0e28710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d22409cfae24b46923c4e5bc6639fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:38:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Creating image(s)
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "/opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "/opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk 1073741824" returned: 0 in 0.061s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:38:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Successfully created port: 05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Cannot resize image /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Ensure instance console log exists: /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Successfully updated port: 05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquired lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-changed-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.compute.manager [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Refreshing instance network info cache due to event network-changed-05378b2b-9c4b-444f-9bce-4b0853ef802a. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] Acquiring lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating instance_info_cache with network_info: [{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Releasing lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Instance network_info: |[{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] Acquired lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.network.neutron [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Refreshing network info cache for port 05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Start _get_guest_xml network_info=[{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:38:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:38:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:38:36 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2034969990',display_name='tempest-AttachVolumeTestJSON-server-2034969990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2034969990',id=49,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0MwbKvi2+r2USAUIUzJ5jkkZ00n2Ng66NMC3XPAFMji1C8WE+6xEDQKjsG5A/XFLY28zfzuzr8dKDEww92maP+zAu9y9jgMHQD9zlCFkvP0yBSUhiJ54r6ec1aPEj8Zw==',key_name='tempest-keypair-2029919046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-uiu9owjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=1b89e8a2-3e10-4720-97f1-46639035c4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e1:d0,bridge_name='br-int',has_traffic_filtering=True,id=05378b2b-9c4b-444f-9bce-4b0853ef802a,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05378b2b-9c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:38:37 user nova-compute[75734]:   <uuid>1b89e8a2-3e10-4720-97f1-46639035c4b2</uuid>
Nov 22 16:38:37 user nova-compute[75734]:   <name>instance-00000031</name>
Nov 22 16:38:37 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:38:37 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:38:37 user nova-compute[75734]:   <metadata>
Nov 22 16:38:37 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:38:37 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:38:37 user nova-compute[75734]:       <nova:name>tempest-AttachVolumeTestJSON-server-2034969990</nova:name>
Nov 22 16:38:37 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:38:36</nova:creationTime>
Nov 22 16:38:37 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:38:37 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:38:37 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:38:37 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:38:37 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:38:37 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:38:37 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:38:37 user nova-compute[75734]:       <nova:owner>
Nov 22 16:38:37 user nova-compute[75734]:         <nova:user uuid="0f7b8124d8ef489496bcb5bab0e28710">tempest-AttachVolumeTestJSON-146842854-project-member</nova:user>
Nov 22 16:38:37 user nova-compute[75734]:         <nova:project uuid="3d22409cfae24b46923c4e5bc6639fdb">tempest-AttachVolumeTestJSON-146842854</nova:project>
Nov 22 16:38:37 user nova-compute[75734]:       </nova:owner>
Nov 22 16:38:37 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:38:37 user nova-compute[75734]:       <nova:ports>
Nov 22 16:38:37 user nova-compute[75734]:         <nova:port uuid="05378b2b-9c4b-444f-9bce-4b0853ef802a">
Nov 22 16:38:37 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 16:38:37 user nova-compute[75734]:         </nova:port>
Nov 22 16:38:37 user nova-compute[75734]:       </nova:ports>
Nov 22 16:38:37 user nova-compute[75734]:     </nova:instance>
Nov 22 16:38:37 user nova-compute[75734]:   </metadata>
Nov 22 16:38:37 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:38:37 user nova-compute[75734]:     <system>
Nov 22 16:38:37 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:38:37 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:38:37 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:38:37 user nova-compute[75734]:       <entry name="serial">1b89e8a2-3e10-4720-97f1-46639035c4b2</entry>
Nov 22 16:38:37 user nova-compute[75734]:       <entry name="uuid">1b89e8a2-3e10-4720-97f1-46639035c4b2</entry>
Nov 22 16:38:37 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:38:37 user nova-compute[75734]:     </system>
Nov 22 16:38:37 user nova-compute[75734]:   </sysinfo>
Nov 22 16:38:37 user nova-compute[75734]:   <os>
Nov 22 16:38:37 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:38:37 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:38:37 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:38:37 user nova-compute[75734]:   </os>
Nov 22 16:38:37 user nova-compute[75734]:   <features>
Nov 22 16:38:37 user nova-compute[75734]:     <acpi/>
Nov 22 16:38:37 user nova-compute[75734]:     <apic/>
Nov 22 16:38:37 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:38:37 user nova-compute[75734]:   </features>
Nov 22 16:38:37 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:38:37 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:38:37 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:38:37 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:38:37 user nova-compute[75734]:   </clock>
Nov 22 16:38:37 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:38:37 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:38:37 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:38:37 user nova-compute[75734]:   </cpu>
Nov 22 16:38:37 user nova-compute[75734]:   <devices>
Nov 22 16:38:37 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:38:37 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:38:37 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk"/>
Nov 22 16:38:37 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:38:37 user nova-compute[75734]:     </disk>
Nov 22 16:38:37 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:38:37 user nova-compute[75734]:       <mac address="fa:16:3e:f2:e1:d0"/>
Nov 22 16:38:37 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:38:37 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:38:37 user nova-compute[75734]:       <target dev="tap05378b2b-9c"/>
Nov 22 16:38:37 user nova-compute[75734]:     </interface>
Nov 22 16:38:37 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:38:37 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/console.log" append="off"/>
Nov 22 16:38:37 user nova-compute[75734]:     </serial>
Nov 22 16:38:37 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:38:37 user nova-compute[75734]:     <video>
Nov 22 16:38:37 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:38:37 user nova-compute[75734]:     </video>
Nov 22 16:38:37 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:38:37 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:38:37 user nova-compute[75734]:     </rng>
Nov 22 16:38:37 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:38:37 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:38:37 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:38:37 user nova-compute[75734]:     </memballoon>
Nov 22 16:38:37 user nova-compute[75734]:   </devices>
Nov 22 16:38:37 user nova-compute[75734]: </domain>
Nov 22 16:38:37 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2034969990',display_name='tempest-AttachVolumeTestJSON-server-2034969990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2034969990',id=49,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0MwbKvi2+r2USAUIUzJ5jkkZ00n2Ng66NMC3XPAFMji1C8WE+6xEDQKjsG5A/XFLY28zfzuzr8dKDEww92maP+zAu9y9jgMHQD9zlCFkvP0yBSUhiJ54r6ec1aPEj8Zw==',key_name='tempest-keypair-2029919046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-uiu9owjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=1b89e8a2-3e10-4720-97f1-46639035c4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e1:d0,bridge_name='br-int',has_traffic_filtering=True,id=05378b2b-9c4b-444f-9bce-4b0853ef802a,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05378b2b-9c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG os_vif [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e1:d0,bridge_name='br-int',has_traffic_filtering=True,id=05378b2b-9c4b-444f-9bce-4b0853ef802a,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05378b2b-9c') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88e9542e-2e37-5be1-8247-1c5b7cfdd997', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05378b2b-9c, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05378b2b-9c, col_values=(('qos', UUID('2ee8db0a-7194-4adb-894e-116b1d3f77d9')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05378b2b-9c, col_values=(('external_ids', {'iface-id': '05378b2b-9c4b-444f-9bce-4b0853ef802a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:e1:d0', 'vm-uuid': '1b89e8a2-3e10-4720-97f1-46639035c4b2'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:37 user nova-compute[75734]: INFO os_vif [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e1:d0,bridge_name='br-int',has_traffic_filtering=True,id=05378b2b-9c4b-444f-9bce-4b0853ef802a,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05378b2b-9c')
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No VIF found with MAC fa:16:3e:f2:e1:d0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updated VIF entry in instance network info cache for port 05378b2b-9c4b-444f-9bce-4b0853ef802a. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG nova.network.neutron [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating instance_info_cache with network_info: [{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:38:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-c3a76e2a-89b0-450e-9502-419a571ac77e req-55ced849-3071-43df-966a-19788b9f07e1 service nova] Releasing lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-2c61cb0f-346f-44ed-957d-fa5e988f4179 req-a46a9da2-456f-4bc3-90fd-1f590f47bddd service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2c61cb0f-346f-44ed-957d-fa5e988f4179 req-a46a9da2-456f-4bc3-90fd-1f590f47bddd service nova] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2c61cb0f-346f-44ed-957d-fa5e988f4179 req-a46a9da2-456f-4bc3-90fd-1f590f47bddd service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2c61cb0f-346f-44ed-957d-fa5e988f4179 req-a46a9da2-456f-4bc3-90fd-1f590f47bddd service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-2c61cb0f-346f-44ed-957d-fa5e988f4179 req-a46a9da2-456f-4bc3-90fd-1f590f47bddd service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] No waiting events found dispatching network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:38:38 user nova-compute[75734]: WARNING nova.compute.manager [req-2c61cb0f-346f-44ed-957d-fa5e988f4179 req-a46a9da2-456f-4bc3-90fd-1f590f47bddd service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received unexpected event network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a for instance with vm_state building and task_state spawning.
Nov 22 16:38:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:38:40 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Instance spawned successfully.
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:38:40 user nova-compute[75734]: INFO nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:38:40 user nova-compute[75734]: INFO nova.compute.manager [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Took 5.81 seconds to build instance.
Nov 22 16:38:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-833a4457-090a-4649-9fb2-3b9bba35356d tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.910s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-d550c011-16f4-4fba-bda5-5c3b118251bc req-c9117b6f-d887-412a-a1f8-0b30f0af690f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d550c011-16f4-4fba-bda5-5c3b118251bc req-c9117b6f-d887-412a-a1f8-0b30f0af690f service nova] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d550c011-16f4-4fba-bda5-5c3b118251bc req-c9117b6f-d887-412a-a1f8-0b30f0af690f service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d550c011-16f4-4fba-bda5-5c3b118251bc req-c9117b6f-d887-412a-a1f8-0b30f0af690f service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:38:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-d550c011-16f4-4fba-bda5-5c3b118251bc req-c9117b6f-d887-412a-a1f8-0b30f0af690f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] No waiting events found dispatching network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:38:40 user nova-compute[75734]: WARNING nova.compute.manager [req-d550c011-16f4-4fba-bda5-5c3b118251bc req-c9117b6f-d887-412a-a1f8-0b30f0af690f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received unexpected event network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a for instance with vm_state active and task_state None.
Nov 22 16:38:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:38:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:38:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:38:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:38:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:39:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:39:19 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:39:19 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9063MB free_disk=24.96420669555664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:39:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:39:20 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:20 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:21 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:39:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:39:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:39:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:39:26 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:28 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:39:28 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:39:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:39:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:39:28 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:39:28 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:39:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating instance_info_cache with network_info: [{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:39:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:39:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:39:29 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:34 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:39 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:39:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:39:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:39:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:39:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:39:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:39:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:39:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:39:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:39:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:39:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:39:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:40:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:40:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:40:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:40:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:20 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:40:20 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:40:20 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9084MB free_disk=24.96361541748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:40:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:40:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:40:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-changed-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:40:25 user nova-compute[75734]: DEBUG nova.compute.manager [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Refreshing instance network info cache due to event network-changed-05378b2b-9c4b-444f-9bce-4b0853ef802a. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:40:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] Acquiring lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:40:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] Acquired lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:40:25 user nova-compute[75734]: DEBUG nova.network.neutron [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Refreshing network info cache for port 05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:40:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updated VIF entry in instance network info cache for port 05378b2b-9c4b-444f-9bce-4b0853ef802a. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:40:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating instance_info_cache with network_info: [{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:40:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-0720ff61-cb64-49a4-8a13-327efb14ce4c req-a6a3ec84-88ea-40e0-a0ca-99ba6021f49f service nova] Releasing lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:28 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG nova.objects.instance [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:29 user nova-compute[75734]: INFO nova.compute.manager [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Attaching volume 6352b225-63bb-4609-b80e-98e6fad17dcd to /dev/vdb
Nov 22 16:40:29 user nova-compute[75734]: DEBUG os_brick.utils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62659b-4aec-4e82-ab59-663362e8bc9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d36d74-6eef-4ed7-8812-f0fcff17fc5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[40169c31-4279-4374-9e6d-cd71fe54a4b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f6cd02-c88d-4a22-9a94-26b83fc11eb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:40:29 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:40:29 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df61fd6-1b77-40c8-864a-6e7531d51448]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG os_brick.utils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:40:29 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating existing volume attachment record: 0861b43d-4eda-4b56-a8a0-96fd04c95eee {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:40:30 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating instance_info_cache with network_info: [{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:40:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:40:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:40:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cafZRIvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:40:37 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:40:37 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:40:37 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f731c8a7-bcc1-4a16-9cfc-57363299909f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:40:37 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6c63aa-77b0-440e-aabf-efa14bca140b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd] added
Nov 22 16:40:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cdb6ea-aa6a-41cd-a1c3-86ca5a5b52e2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8547e68b-99fb-4b48-84c5-25e36e046f88]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cafZRIvu {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cafZRIvu" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2c85f8-4bf8-4683-b584-a98fb29c66ca]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cafZRIvu'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed68ea6-e44c-4fb7-a004-51833971773c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1d943-1a35-4efc-a100-c689d18037d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:40:37 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:40:37 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:40:37 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:40:37 user nova-compute[75734]: 
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af4fef-ab0c-44ba-811a-9c4c5279ca1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260]
Nov 22 16:40:37 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260] successful.
Nov 22 16:40:37 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d593cdb6-1689-48f2-912a-4094785b0207]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eadc0e-1e41-44b3-b7b6-47e54fd99b40]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:40:38 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:40:38 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3e55e1-bee9-47fa-beb7-27dc0d06f3e0]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:38 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cafZRIvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23637623033343732', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637623033343732', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG nova.objects.instance [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:40:39 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:40:39 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:40:39 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:40:39 user nova-compute[75734]:   <serial>6352b225-63bb-4609-b80e-98e6fad17dcd</serial>
Nov 22 16:40:39 user nova-compute[75734]: </disk>
Nov 22 16:40:39 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No VIF found with MAC fa:16:3e:f2:e1:d0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:40:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-00de9eb9-0d73-4883-8bbf-4b60527db637 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.880s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:40:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:40:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:40:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG nova.objects.instance [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:43 user nova-compute[75734]: INFO nova.compute.manager [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Attaching volume 79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa to /dev/vdc
Nov 22 16:40:43 user nova-compute[75734]: DEBUG os_brick.utils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23bfe3c-7b17-447e-803e-75f85fe35124]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d7e76-635c-4bf9-a778-a4084eb7f451]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1db4555-c9ae-4a5f-bfe3-55e62fa1ac09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4467173-ab3d-42b8-a2b1-b0f4b985e202]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:40:43 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:40:43 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac37ae70-a9b3-4660-9762-5b638b8ff944]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG os_brick.utils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:40:43 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating existing volume attachment record: d2212bbd-93aa-472a-9023-60a121c8d84a {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:40:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkwUNJFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:40:49 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:40:49 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:40:49 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f624fb-d05c-411c-9b78-f019911bd871]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:40:49 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da6f84-7075-4f62-9cfd-f5d8c0fa96df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa] added
Nov 22 16:40:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b23a12e-000e-4281-a17c-2eef6edaa163]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b21d47-c550-4dee-994d-b65c1827153e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkwUNJFr {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkwUNJFr" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c309cb1-b0d7-4d31-b52f-ce4e1d208fb7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gkwUNJFr'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c58eb-3bc3-4532-b95a-49582c5436df]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddfa92b-f836-4ba2-979e-57ffb602920b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:40:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:40:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0507306a-e21a-4cd8-ae92-2a0250fca771]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260]
Nov 22 16:40:49 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260] successful.
Nov 22 16:40:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b3ea88-0333-4552-9f68-509c2aa580a0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e9eb04-8d13-4bd0-b0c5-4e75abb3b8b0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:40:49 user nova-compute[75734]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)
Nov 22 16:40:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:40:49 user nova-compute[75734]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)
Nov 22 16:40:49 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60a93ff-b548-4090-8c55-80079304f15c]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:40:49 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:40:50 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:40:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkwUNJFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:40:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:40:50 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23930346336346264', 'path': '/dev/sdc'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:40:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930346336346264', 'path': '/dev/sdc'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:40:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:40:50 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:40:50 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:40:50 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:40:50 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:40:50 user nova-compute[75734]:   <serial>79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa</serial>
Nov 22 16:40:50 user nova-compute[75734]: </disk>
Nov 22 16:40:50 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:40:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:40:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:40:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:40:51 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] No VIF found with MAC fa:16:3e:f2:e1:d0, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:40:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-d98e59c4-6f4d-47bf-84a0-26cf98682178 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.992s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:40:52 user nova-compute[75734]: INFO nova.compute.manager [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Detaching volume 6352b225-63bb-4609-b80e-98e6fad17dcd
Nov 22 16:40:52 user nova-compute[75734]: INFO nova.virt.block_device [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Attempting to driver detach volume 6352b225-63bb-4609-b80e-98e6fad17dcd from mountpoint /dev/vdb
Nov 22 16:40:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Attempting to detach device vdb from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:40:52 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:40:52 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:40:52 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:40:52 user nova-compute[75734]:   <serial>6352b225-63bb-4609-b80e-98e6fad17dcd</serial>
Nov 22 16:40:52 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:40:52 user nova-compute[75734]: </disk>
Nov 22 16:40:52 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:40:52 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully detached device vdb from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the persistent domain config.
Nov 22 16:40:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:40:52 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:40:52 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:40:52 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:40:52 user nova-compute[75734]:   <serial>6352b225-63bb-4609-b80e-98e6fad17dcd</serial>
Nov 22 16:40:52 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:40:52 user nova-compute[75734]: </disk>
Nov 22 16:40:52 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:40:52 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:40:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:40:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:41:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:12 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 is timed out.
Nov 22 16:41:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully detached device vdb from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the live domain config.
Nov 22 16:41:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cafZRIvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:41:12 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:41:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f7bf82-5164-44c3-8447-e7ab9ea4ef99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:41:12 user nova-compute[75734]: No targets found.
Nov 22 16:41:12 user nova-compute[75734]: iSNS:
Nov 22 16:41:12 user nova-compute[75734]: No targets found.
Nov 22 16:41:12 user nova-compute[75734]: STATIC:
Nov 22 16:41:12 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd
Nov 22 16:41:12 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:41:12 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:41:12 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa
Nov 22 16:41:12 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:41:12 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:41:12 user nova-compute[75734]: FIRMWARE:
Nov 22 16:41:12 user nova-compute[75734]: No targets found.
Nov 22 16:41:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:41:12 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:41:12 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06c3e1f-7f83-480b-a2ad-9cecec4300ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[56175cb0-81d8-4fd6-91ad-1813c870f78f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:41:13 user nova-compute[75734]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)
Nov 22 16:41:13 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd (non-flash)
Nov 22 16:41:13 user nova-compute[75734]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)
Nov 22 16:41:13 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc3d4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacb66bb-0529-4262-b1e4-8090be41e928]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[680d625d-8154-4c67-9cba-b4b80710d9bc]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[714c55fe-a4d9-4f70-84db-35f0a60e1689]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c2fa8-5b43-4926-afab-d9e6d55fe06d]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0706ee2-9982-4feb-a1f4-028160deb2e6]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e687db94-50c1-4863-91b1-0a207ae7fde8]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260]
Nov 22 16:41:13 user nova-compute[75734]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd, portal: 172.16.0.220,3260] successful.
Nov 22 16:41:13 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6352b225-63bb-4609-b80e-98e6fad17dcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243916c-1545-4b91-8fe6-7a56bdbd7d4d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== disconnect_volume: return (310ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:41:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:41:14 user nova-compute[75734]: DEBUG nova.objects.instance [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:41:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-8e0f39ad-71f7-4d39-b611-d560ee89c368 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:15 user nova-compute[75734]: INFO nova.compute.manager [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Detaching volume 79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa
Nov 22 16:41:15 user nova-compute[75734]: INFO nova.virt.block_device [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Attempting to driver detach volume 79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa from mountpoint /dev/vdc
Nov 22 16:41:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Attempting to detach device vdc from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:41:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:41:15 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:41:15 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:41:15 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:41:15 user nova-compute[75734]:   <serial>79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa</serial>
Nov 22 16:41:15 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 16:41:15 user nova-compute[75734]: </disk>
Nov 22 16:41:15 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:41:15 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully detached device vdc from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the persistent domain config.
Nov 22 16:41:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:41:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:41:15 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:41:15 user nova-compute[75734]:   <source dev="/dev/sdc"/>
Nov 22 16:41:15 user nova-compute[75734]:   <target dev="vdc" bus="virtio"/>
Nov 22 16:41:15 user nova-compute[75734]:   <serial>79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa</serial>
Nov 22 16:41:15 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 16:41:15 user nova-compute[75734]: </disk>
Nov 22 16:41:15 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:41:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:41:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:41:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:41:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:41:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9063MB free_disk=24.962024688720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:41:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:41:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:29 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:41:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:41:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:41:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:41:31 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:41:31 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:41:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:32 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating instance_info_cache with network_info: [{"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:41:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-1b89e8a2-3e10-4720-97f1-46639035c4b2" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:41:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:41:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:35 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 is timed out.
Nov 22 16:41:35 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully detached device vdc from instance 1b89e8a2-3e10-4720-97f1-46639035c4b2 from the live domain config.
Nov 22 16:41:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkwUNJFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:41:35 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef5fbd-a758-447f-a276-26257034b338]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:41:35 user nova-compute[75734]: No targets found.
Nov 22 16:41:35 user nova-compute[75734]: iSNS:
Nov 22 16:41:35 user nova-compute[75734]: No targets found.
Nov 22 16:41:35 user nova-compute[75734]: STATIC:
Nov 22 16:41:35 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa
Nov 22 16:41:35 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:41:35 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:41:35 user nova-compute[75734]: FIRMWARE:
Nov 22 16:41:35 user nova-compute[75734]: No targets found.
Nov 22 16:41:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:41:35 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:41:35 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2204b6e-0e7f-40ed-b0c0-7b3c127a248b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd393cc9-52ed-4454-9dd7-fa5ca4861a12]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)
Nov 22 16:41:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa (non-flash)
Nov 22 16:41:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac4e0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa'): ({'sdc'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Removing single pathed devices sdc {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d0b7eb-8197-44f1-991f-fdcdf62c1e33]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79ed270-4e98-4a9c-9e29-dc61a88ebacd]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Flushing IO for device /dev/sdc {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfcba34-1dad-480c-9b7e-aacae0e2016b]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9520380-d6de-4f8d-b489-62866011247b]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] SCSI volumes sdc have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[00261723-e2fa-4117-b858-0429cb044615]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe070b5-b159-4d04-9f46-9b856828cd92]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260]
Nov 22 16:41:35 user nova-compute[75734]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa, portal: 172.16.0.220,3260] successful.
Nov 22 16:41:35 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79c76fb2-2598-4f8e-8e6c-f6bdddef7dfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea28e07-cd5a-4bce-af7c-87572d523482]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] <== disconnect_volume: return (272ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:41:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:41:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:41:36 user nova-compute[75734]: DEBUG nova.objects.instance [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'flavor' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:41:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-460ce2a4-e46f-48c8-ad69-54f219392e98 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:37 user nova-compute[75734]: INFO nova.compute.manager [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Terminating instance
Nov 22 16:41:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-6cbcf99d-719a-4d8e-b351-c1297680c2b0 req-88f5ae82-4ab1-4d0a-a4cf-d5dcb7f4969f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-vif-unplugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6cbcf99d-719a-4d8e-b351-c1297680c2b0 req-88f5ae82-4ab1-4d0a-a4cf-d5dcb7f4969f service nova] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6cbcf99d-719a-4d8e-b351-c1297680c2b0 req-88f5ae82-4ab1-4d0a-a4cf-d5dcb7f4969f service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6cbcf99d-719a-4d8e-b351-c1297680c2b0 req-88f5ae82-4ab1-4d0a-a4cf-d5dcb7f4969f service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-6cbcf99d-719a-4d8e-b351-c1297680c2b0 req-88f5ae82-4ab1-4d0a-a4cf-d5dcb7f4969f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] No waiting events found dispatching network-vif-unplugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.compute.manager [req-6cbcf99d-719a-4d8e-b351-c1297680c2b0 req-88f5ae82-4ab1-4d0a-a4cf-d5dcb7f4969f service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-vif-unplugged-05378b2b-9c4b-444f-9bce-4b0853ef802a for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Instance destroyed successfully.
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.objects.instance [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lazy-loading 'resources' on Instance uuid 1b89e8a2-3e10-4720-97f1-46639035c4b2 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2034969990',display_name='tempest-AttachVolumeTestJSON-server-2034969990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2034969990',id=49,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0MwbKvi2+r2USAUIUzJ5jkkZ00n2Ng66NMC3XPAFMji1C8WE+6xEDQKjsG5A/XFLY28zfzuzr8dKDEww92maP+zAu9y9jgMHQD9zlCFkvP0yBSUhiJ54r6ec1aPEj8Zw==',key_name='tempest-keypair-2029919046',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:38:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d22409cfae24b46923c4e5bc6639fdb',ramdisk_id='',reservation_id='r-uiu9owjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-146842854',owner_user_name='tempest-AttachVolumeTestJSON-146842854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:38:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f7b8124d8ef489496bcb5bab0e28710',uuid=1b89e8a2-3e10-4720-97f1-46639035c4b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converting VIF {"id": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "address": "fa:16:3e:f2:e1:d0", "network": {"id": "200264bd-ac34-4209-999f-e86f9db889e8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-986382075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d22409cfae24b46923c4e5bc6639fdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05378b2b-9c", "ovs_interfaceid": "05378b2b-9c4b-444f-9bce-4b0853ef802a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:e1:d0,bridge_name='br-int',has_traffic_filtering=True,id=05378b2b-9c4b-444f-9bce-4b0853ef802a,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05378b2b-9c') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG os_vif [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:e1:d0,bridge_name='br-int',has_traffic_filtering=True,id=05378b2b-9c4b-444f-9bce-4b0853ef802a,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05378b2b-9c') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05378b2b-9c, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ee8db0a-7194-4adb-894e-116b1d3f77d9) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:38 user nova-compute[75734]: INFO os_vif [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:e1:d0,bridge_name='br-int',has_traffic_filtering=True,id=05378b2b-9c4b-444f-9bce-4b0853ef802a,network=Network(200264bd-ac34-4209-999f-e86f9db889e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05378b2b-9c')
Nov 22 16:41:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Deleting instance files /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2_del
Nov 22 16:41:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Deletion of /opt/stack/data/nova/instances/1b89e8a2-3e10-4720-97f1-46639035c4b2_del complete
Nov 22 16:41:38 user nova-compute[75734]: INFO nova.compute.manager [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 16:41:38 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:41:38 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:41:39 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:41:39 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Took 0.79 seconds to deallocate network for instance.
Nov 22 16:41:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-75b7ad66-d096-483f-809a-65a9e77e0c2a req-1a3f9c8c-f90a-45b0-aba3-05ede2db9ed6 service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-vif-deleted-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:41:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:39 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:41:39 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:41:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:39 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Deleted allocations for instance 1b89e8a2-3e10-4720-97f1-46639035c4b2
Nov 22 16:41:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-7776c93c-ec33-496a-8d9d-e88b39c153a6 tempest-AttachVolumeTestJSON-146842854 tempest-AttachVolumeTestJSON-146842854-project-member] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-f301012a-1ab4-4dfb-9798-38d0820c7d48 req-329f2811-8a2b-44ec-a8b4-d5213419e8dc service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received event network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:41:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f301012a-1ab4-4dfb-9798-38d0820c7d48 req-329f2811-8a2b-44ec-a8b4-d5213419e8dc service nova] Acquiring lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:41:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f301012a-1ab4-4dfb-9798-38d0820c7d48 req-329f2811-8a2b-44ec-a8b4-d5213419e8dc service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:41:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f301012a-1ab4-4dfb-9798-38d0820c7d48 req-329f2811-8a2b-44ec-a8b4-d5213419e8dc service nova] Lock "1b89e8a2-3e10-4720-97f1-46639035c4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:41:40 user nova-compute[75734]: DEBUG nova.compute.manager [req-f301012a-1ab4-4dfb-9798-38d0820c7d48 req-329f2811-8a2b-44ec-a8b4-d5213419e8dc service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] No waiting events found dispatching network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:41:40 user nova-compute[75734]: WARNING nova.compute.manager [req-f301012a-1ab4-4dfb-9798-38d0820c7d48 req-329f2811-8a2b-44ec-a8b4-d5213419e8dc service nova] [instance: 1b89e8a2-3e10-4720-97f1-46639035c4b2] Received unexpected event network-vif-plugged-05378b2b-9c4b-444f-9bce-4b0853ef802a for instance with vm_state deleted and task_state None.
Nov 22 16:41:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:41:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:41:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:41:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:41:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:42:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:42:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:42:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:42:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:42:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:42:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:42:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:42:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:42:21 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:42:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:42:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:42:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9210MB free_disk=24.989158630371094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:42:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:42:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:42:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:42:29 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:42:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "4cf6e208-7942-405d-9c49-dec75da0c613" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "4cf6e208-7942-405d-9c49-dec75da0c613" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:42:58 user nova-compute[75734]: INFO nova.compute.claims [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Claim successful on node user
Nov 22 16:42:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:42:58 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:42:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.policy [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52c4082d9705485a9db20cd3ed46a479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '603d1b417993487288a653f5ef5133e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:42:59 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Creating image(s)
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "/opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "/opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.network.neutron [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Successfully created port: 784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544,backing_fmt=raw /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk 1073741824" returned: 0 in 0.049s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "9f6b617d4cf0bbb60dbd9ccce1105ab67232c544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f6b617d4cf0bbb60dbd9ccce1105ab67232c544 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:42:59 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Cannot resize image /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Ensure instance console log exists: /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Successfully updated port: 784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquired lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received event network-changed-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.compute.manager [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Refreshing instance network info cache due to event network-changed-784368cf-0b2c-41f0-a07d-25355d2474d5. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] Acquiring lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.neutron [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updating instance_info_cache with network_info: [{"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Releasing lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Instance network_info: |[{"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] Acquired lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.neutron [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Refreshing network info cache for port 784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Start _get_guest_xml network_info=[{"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '9f27db0a-f3d9-4491-93dc-75dd864eab9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:43:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:43:00 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9f27db0a-f3d9-4491-93dc-75dd864eab9b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='16df9f1ed66047ddbda80839130fece9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T15:49:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1787566979',display_name='tempest-VolumesActionsTest-instance-1787566979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1787566979',id=50,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='603d1b417993487288a653f5ef5133e6',ramdisk_id='',reservation_id='r-wqrj0lff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-127410557',owner_user_name='tempest-VolumesActionsTest-127410557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:42:59Z,user_data=None,user_id='52c4082d9705485a9db20cd3ed46a479',uuid=4cf6e208-7942-405d-9c49-dec75da0c613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Converting VIF {"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7b:56,bridge_name='br-int',has_traffic_filtering=True,id=784368cf-0b2c-41f0-a07d-25355d2474d5,network=Network(64dfae5d-e728-4dda-a7f3-e7da4cec13c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784368cf-0b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.objects.instance [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cf6e208-7942-405d-9c49-dec75da0c613 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:43:00 user nova-compute[75734]:   <uuid>4cf6e208-7942-405d-9c49-dec75da0c613</uuid>
Nov 22 16:43:00 user nova-compute[75734]:   <name>instance-00000032</name>
Nov 22 16:43:00 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:43:00 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:43:00 user nova-compute[75734]:   <metadata>
Nov 22 16:43:00 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:43:00 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:43:00 user nova-compute[75734]:       <nova:name>tempest-VolumesActionsTest-instance-1787566979</nova:name>
Nov 22 16:43:00 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:43:00</nova:creationTime>
Nov 22 16:43:00 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:43:00 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:43:00 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:43:00 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:43:00 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:43:00 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:43:00 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:43:00 user nova-compute[75734]:       <nova:owner>
Nov 22 16:43:00 user nova-compute[75734]:         <nova:user uuid="52c4082d9705485a9db20cd3ed46a479">tempest-VolumesActionsTest-127410557-project-member</nova:user>
Nov 22 16:43:00 user nova-compute[75734]:         <nova:project uuid="603d1b417993487288a653f5ef5133e6">tempest-VolumesActionsTest-127410557</nova:project>
Nov 22 16:43:00 user nova-compute[75734]:       </nova:owner>
Nov 22 16:43:00 user nova-compute[75734]:       <nova:root type="image" uuid="9f27db0a-f3d9-4491-93dc-75dd864eab9b"/>
Nov 22 16:43:00 user nova-compute[75734]:       <nova:ports>
Nov 22 16:43:00 user nova-compute[75734]:         <nova:port uuid="784368cf-0b2c-41f0-a07d-25355d2474d5">
Nov 22 16:43:00 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 16:43:00 user nova-compute[75734]:         </nova:port>
Nov 22 16:43:00 user nova-compute[75734]:       </nova:ports>
Nov 22 16:43:00 user nova-compute[75734]:     </nova:instance>
Nov 22 16:43:00 user nova-compute[75734]:   </metadata>
Nov 22 16:43:00 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:43:00 user nova-compute[75734]:     <system>
Nov 22 16:43:00 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:43:00 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:43:00 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:43:00 user nova-compute[75734]:       <entry name="serial">4cf6e208-7942-405d-9c49-dec75da0c613</entry>
Nov 22 16:43:00 user nova-compute[75734]:       <entry name="uuid">4cf6e208-7942-405d-9c49-dec75da0c613</entry>
Nov 22 16:43:00 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:43:00 user nova-compute[75734]:     </system>
Nov 22 16:43:00 user nova-compute[75734]:   </sysinfo>
Nov 22 16:43:00 user nova-compute[75734]:   <os>
Nov 22 16:43:00 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:43:00 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:43:00 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:43:00 user nova-compute[75734]:   </os>
Nov 22 16:43:00 user nova-compute[75734]:   <features>
Nov 22 16:43:00 user nova-compute[75734]:     <acpi/>
Nov 22 16:43:00 user nova-compute[75734]:     <apic/>
Nov 22 16:43:00 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:43:00 user nova-compute[75734]:   </features>
Nov 22 16:43:00 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:43:00 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:43:00 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:43:00 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:43:00 user nova-compute[75734]:   </clock>
Nov 22 16:43:00 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:43:00 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:43:00 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:43:00 user nova-compute[75734]:   </cpu>
Nov 22 16:43:00 user nova-compute[75734]:   <devices>
Nov 22 16:43:00 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:43:00 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:43:00 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk"/>
Nov 22 16:43:00 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:43:00 user nova-compute[75734]:     </disk>
Nov 22 16:43:00 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:43:00 user nova-compute[75734]:       <mac address="fa:16:3e:cd:7b:56"/>
Nov 22 16:43:00 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:43:00 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:43:00 user nova-compute[75734]:       <target dev="tap784368cf-0b"/>
Nov 22 16:43:00 user nova-compute[75734]:     </interface>
Nov 22 16:43:00 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:43:00 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/console.log" append="off"/>
Nov 22 16:43:00 user nova-compute[75734]:     </serial>
Nov 22 16:43:00 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:43:00 user nova-compute[75734]:     <video>
Nov 22 16:43:00 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:43:00 user nova-compute[75734]:     </video>
Nov 22 16:43:00 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:43:00 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:43:00 user nova-compute[75734]:     </rng>
Nov 22 16:43:00 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:43:00 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:43:00 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:43:00 user nova-compute[75734]:     </memballoon>
Nov 22 16:43:00 user nova-compute[75734]:   </devices>
Nov 22 16:43:00 user nova-compute[75734]: </domain>
Nov 22 16:43:00 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1787566979',display_name='tempest-VolumesActionsTest-instance-1787566979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1787566979',id=50,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='603d1b417993487288a653f5ef5133e6',ramdisk_id='',reservation_id='r-wqrj0lff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-127410557',owner_user_name='tempest-VolumesActionsTest-127410557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:42:59Z,user_data=None,user_id='52c4082d9705485a9db20cd3ed46a479',uuid=4cf6e208-7942-405d-9c49-dec75da0c613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Converting VIF {"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7b:56,bridge_name='br-int',has_traffic_filtering=True,id=784368cf-0b2c-41f0-a07d-25355d2474d5,network=Network(64dfae5d-e728-4dda-a7f3-e7da4cec13c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784368cf-0b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG os_vif [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7b:56,bridge_name='br-int',has_traffic_filtering=True,id=784368cf-0b2c-41f0-a07d-25355d2474d5,network=Network(64dfae5d-e728-4dda-a7f3-e7da4cec13c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784368cf-0b') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75d76ca4-d8d4-518e-be26-d6e8716c51fc', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap784368cf-0b, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap784368cf-0b, col_values=(('qos', UUID('843bb633-e3d6-490a-a343-fca2a7cc628e')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap784368cf-0b, col_values=(('external_ids', {'iface-id': '784368cf-0b2c-41f0-a07d-25355d2474d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:7b:56', 'vm-uuid': '4cf6e208-7942-405d-9c49-dec75da0c613'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:00 user nova-compute[75734]: INFO os_vif [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7b:56,bridge_name='br-int',has_traffic_filtering=True,id=784368cf-0b2c-41f0-a07d-25355d2474d5,network=Network(64dfae5d-e728-4dda-a7f3-e7da4cec13c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784368cf-0b')
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] No VIF found with MAC fa:16:3e:cd:7b:56, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.neutron [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updated VIF entry in instance network info cache for port 784368cf-0b2c-41f0-a07d-25355d2474d5. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:43:00 user nova-compute[75734]: DEBUG nova.network.neutron [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updating instance_info_cache with network_info: [{"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:43:01 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-834db68d-ecba-4e7d-8fe1-86d4fcfe8984 req-a2d254e0-549e-4368-82cd-28ea2544a666 service nova] Releasing lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-834b5328-ca6d-4762-94b2-0cf195396918 req-e3309a80-3402-4729-8ff3-f528c12d5b68 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received event network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-834b5328-ca6d-4762-94b2-0cf195396918 req-e3309a80-3402-4729-8ff3-f528c12d5b68 service nova] Acquiring lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-834b5328-ca6d-4762-94b2-0cf195396918 req-e3309a80-3402-4729-8ff3-f528c12d5b68 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-834b5328-ca6d-4762-94b2-0cf195396918 req-e3309a80-3402-4729-8ff3-f528c12d5b68 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG nova.compute.manager [req-834b5328-ca6d-4762-94b2-0cf195396918 req-e3309a80-3402-4729-8ff3-f528c12d5b68 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] No waiting events found dispatching network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:43:02 user nova-compute[75734]: WARNING nova.compute.manager [req-834b5328-ca6d-4762-94b2-0cf195396918 req-e3309a80-3402-4729-8ff3-f528c12d5b68 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received unexpected event network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 for instance with vm_state building and task_state spawning.
Nov 22 16:43:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:43:04 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Instance spawned successfully.
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:43:04 user nova-compute[75734]: INFO nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:43:04 user nova-compute[75734]: INFO nova.compute.manager [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Took 5.66 seconds to build instance.
Nov 22 16:43:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-86d69b54-61dd-45bb-b684-2c80f1a11195 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "4cf6e208-7942-405d-9c49-dec75da0c613" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.746s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-43ac31ea-ae78-4171-88a3-682fe6744c21 req-2753aa26-c21a-4beb-8a24-c99dc047cf68 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received event network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-43ac31ea-ae78-4171-88a3-682fe6744c21 req-2753aa26-c21a-4beb-8a24-c99dc047cf68 service nova] Acquiring lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-43ac31ea-ae78-4171-88a3-682fe6744c21 req-2753aa26-c21a-4beb-8a24-c99dc047cf68 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-43ac31ea-ae78-4171-88a3-682fe6744c21 req-2753aa26-c21a-4beb-8a24-c99dc047cf68 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:43:04 user nova-compute[75734]: DEBUG nova.compute.manager [req-43ac31ea-ae78-4171-88a3-682fe6744c21 req-2753aa26-c21a-4beb-8a24-c99dc047cf68 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] No waiting events found dispatching network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:43:04 user nova-compute[75734]: WARNING nova.compute.manager [req-43ac31ea-ae78-4171-88a3-682fe6744c21 req-2753aa26-c21a-4beb-8a24-c99dc047cf68 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received unexpected event network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 for instance with vm_state active and task_state None.
Nov 22 16:43:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:43:21 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:43:22 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:43:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.951786041259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 4cf6e208-7942-405d-9c49-dec75da0c613 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:43:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:43:24 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:24 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:25 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:25 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:43:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:33 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 4cf6e208-7942-405d-9c49-dec75da0c613 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:43:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:36 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updating instance_info_cache with network_info: [{"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:43:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:43:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:43:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:43:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:44:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:44:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:44:23 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:44:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:44:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=24.949539184570312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 4cf6e208-7942-405d-9c49-dec75da0c613 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:44:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:44:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:44:26 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:26 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:27 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:44:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:44:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:44:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:44:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:44:37 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:44:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:44:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:44:37 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:44:37 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 4cf6e208-7942-405d-9c49-dec75da0c613 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:44:38 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updating instance_info_cache with network_info: [{"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:44:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-4cf6e208-7942-405d-9c49-dec75da0c613" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:44:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:44:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:44:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:44:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:44:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:44:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:44:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:44:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "4cf6e208-7942-405d-9c49-dec75da0c613" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "4cf6e208-7942-405d-9c49-dec75da0c613" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:44:55 user nova-compute[75734]: INFO nova.compute.manager [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Terminating instance
Nov 22 16:44:55 user nova-compute[75734]: DEBUG nova.compute.manager [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-3590c57f-c626-49eb-bd4d-1071b58f4687 req-9a54390e-2b60-423e-853b-75827ad31606 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received event network-vif-unplugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3590c57f-c626-49eb-bd4d-1071b58f4687 req-9a54390e-2b60-423e-853b-75827ad31606 service nova] Acquiring lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3590c57f-c626-49eb-bd4d-1071b58f4687 req-9a54390e-2b60-423e-853b-75827ad31606 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3590c57f-c626-49eb-bd4d-1071b58f4687 req-9a54390e-2b60-423e-853b-75827ad31606 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-3590c57f-c626-49eb-bd4d-1071b58f4687 req-9a54390e-2b60-423e-853b-75827ad31606 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] No waiting events found dispatching network-vif-unplugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG nova.compute.manager [req-3590c57f-c626-49eb-bd4d-1071b58f4687 req-9a54390e-2b60-423e-853b-75827ad31606 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received event network-vif-unplugged-784368cf-0b2c-41f0-a07d-25355d2474d5 for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Instance destroyed successfully.
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.objects.instance [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lazy-loading 'resources' on Instance uuid 4cf6e208-7942-405d-9c49-dec75da0c613 {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1787566979',display_name='tempest-VolumesActionsTest-instance-1787566979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1787566979',id=50,image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='603d1b417993487288a653f5ef5133e6',ramdisk_id='',reservation_id='r-wqrj0lff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f27db0a-f3d9-4491-93dc-75dd864eab9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-127410557',owner_user_name='tempest-VolumesActionsTest-127410557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:43:04Z,user_data=None,user_id='52c4082d9705485a9db20cd3ed46a479',uuid=4cf6e208-7942-405d-9c49-dec75da0c613,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Converting VIF {"id": "784368cf-0b2c-41f0-a07d-25355d2474d5", "address": "fa:16:3e:cd:7b:56", "network": {"id": "64dfae5d-e728-4dda-a7f3-e7da4cec13c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1872674145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "603d1b417993487288a653f5ef5133e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784368cf-0b", "ovs_interfaceid": "784368cf-0b2c-41f0-a07d-25355d2474d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:7b:56,bridge_name='br-int',has_traffic_filtering=True,id=784368cf-0b2c-41f0-a07d-25355d2474d5,network=Network(64dfae5d-e728-4dda-a7f3-e7da4cec13c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784368cf-0b') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG os_vif [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:7b:56,bridge_name='br-int',has_traffic_filtering=True,id=784368cf-0b2c-41f0-a07d-25355d2474d5,network=Network(64dfae5d-e728-4dda-a7f3-e7da4cec13c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784368cf-0b') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap784368cf-0b, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=843bb633-e3d6-490a-a343-fca2a7cc628e) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:44:56 user nova-compute[75734]: INFO os_vif [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:7b:56,bridge_name='br-int',has_traffic_filtering=True,id=784368cf-0b2c-41f0-a07d-25355d2474d5,network=Network(64dfae5d-e728-4dda-a7f3-e7da4cec13c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784368cf-0b')
Nov 22 16:44:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Deleting instance files /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613_del
Nov 22 16:44:56 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Deletion of /opt/stack/data/nova/instances/4cf6e208-7942-405d-9c49-dec75da0c613_del complete
Nov 22 16:44:56 user nova-compute[75734]: INFO nova.compute.manager [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 16:44:56 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:44:56 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Took 0.43 seconds to deallocate network for instance.
Nov 22 16:44:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:44:56 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:44:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:44:57 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Deleted allocations for instance 4cf6e208-7942-405d-9c49-dec75da0c613
Nov 22 16:44:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-47e727e5-0caa-4fa9-a6b5-2f24cb687850 tempest-VolumesActionsTest-127410557 tempest-VolumesActionsTest-127410557-project-member] Lock "4cf6e208-7942-405d-9c49-dec75da0c613" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.656s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:44:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-eef5457d-3fa9-4372-b05b-2af276c0448d req-55f54fde-244c-4540-96ad-fea27109d7f1 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received event network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:44:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eef5457d-3fa9-4372-b05b-2af276c0448d req-55f54fde-244c-4540-96ad-fea27109d7f1 service nova] Acquiring lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:44:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eef5457d-3fa9-4372-b05b-2af276c0448d req-55f54fde-244c-4540-96ad-fea27109d7f1 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:44:57 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-eef5457d-3fa9-4372-b05b-2af276c0448d req-55f54fde-244c-4540-96ad-fea27109d7f1 service nova] Lock "4cf6e208-7942-405d-9c49-dec75da0c613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:44:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-eef5457d-3fa9-4372-b05b-2af276c0448d req-55f54fde-244c-4540-96ad-fea27109d7f1 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] No waiting events found dispatching network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:44:57 user nova-compute[75734]: WARNING nova.compute.manager [req-eef5457d-3fa9-4372-b05b-2af276c0448d req-55f54fde-244c-4540-96ad-fea27109d7f1 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received unexpected event network-vif-plugged-784368cf-0b2c-41f0-a07d-25355d2474d5 for instance with vm_state deleted and task_state None.
Nov 22 16:44:57 user nova-compute[75734]: DEBUG nova.compute.manager [req-eef5457d-3fa9-4372-b05b-2af276c0448d req-55f54fde-244c-4540-96ad-fea27109d7f1 service nova] [instance: 4cf6e208-7942-405d-9c49-dec75da0c613] Received event network-vif-deleted-784368cf-0b2c-41f0-a07d-25355d2474d5 {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:45:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:45:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:45:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:45:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:45:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:45:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:45:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:24 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:45:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:45:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:45:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:45:25 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:45:25 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:45:25 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9199MB free_disk=24.97653579711914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:45:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:45:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:45:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:45:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:45:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:45:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:45:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:27 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:29 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:29 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:45:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:45:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:45:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:45:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:45:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:45:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:45:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:24 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:46:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:46:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:46:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:46:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:46:24 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:46:24 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9217MB free_disk=24.97466278076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:46:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:46:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:46:25 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:46:25 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:46:25 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:46:25 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:46:25 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:46:25 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:46:26 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:46:28 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:28 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:46:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:33 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:46:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:46:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:46:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:46:41 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:46:46 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:46:51 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:46:56 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:06 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:16 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:47:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:16 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:47:16 user nova-compute[75734]: INFO nova.compute.claims [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Claim successful on node user
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.network.neutron [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:47:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.policy [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6de85c2198a7410291259103e38c5202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f475755bff84214abb76484eb3c2c1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:47:17 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Creating image(s)
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "/opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "/opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "0c87d3711784af7a1e7eab1d7f582f9e03f92664" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "0c87d3711784af7a1e7eab1d7f582f9e03f92664" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:17 user nova-compute[75734]: DEBUG nova.virt.images [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] 79c53300-e61c-41ee-862f-a2f8be158bae was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.part /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Successfully created port: a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.part /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.converted" returned: 0 in 0.498s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "0c87d3711784af7a1e7eab1d7f582f9e03f92664" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.360s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Successfully updated port: a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json" returned: 0 in 0.171s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "0c87d3711784af7a1e7eab1d7f582f9e03f92664" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "0c87d3711784af7a1e7eab1d7f582f9e03f92664" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:47:18 user nova-compute[75734]: DEBUG nova.network.neutron [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing instance network info cache due to event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664,backing_fmt=raw /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664,backing_fmt=raw /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk 1073741824" returned: 0 in 0.062s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "0c87d3711784af7a1e7eab1d7f582f9e03f92664" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance network_info: |[{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Cannot resize image /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Ensure instance console log exists: /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Start _get_guest_xml network_info=[{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T16:47:14Z,direct_url=<?>,disk_format='qcow2',id=79c53300-e61c-41ee-862f-a2f8be158bae,min_disk=0,min_ram=0,name='tempest-scenario-img--1404943647',owner='7f475755bff84214abb76484eb3c2c1d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T16:47:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '79c53300-e61c-41ee-862f-a2f8be158bae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:47:19 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:47:19 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T16:47:14Z,direct_url=<?>,disk_format='qcow2',id=79c53300-e61c-41ee-862f-a2f8be158bae,min_disk=0,min_ram=0,name='tempest-scenario-img--1404943647',owner='7f475755bff84214abb76484eb3c2c1d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T16:47:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1864037322',display_name='tempest-TestMinimumBasicScenario-server-1864037322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1864037322',id=51,image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHddBir0/WXJGNbmSoUQnNIpKWFeV8uM/Gg5q8i3I9NdDv5prXDWIwglAl+p9kdTGtb4TAnRWN5LJptRMALiQqTi8h3AJhxqns+YyNK/eI0driKKf2iLraF3RmtTGgaUNA==',key_name='tempest-TestMinimumBasicScenario-743959776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-10jvoz2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:47:17Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=3bd2906c-90b3-4d5a-a462-e524f3cb439c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.objects.instance [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:47:19 user nova-compute[75734]:   <uuid>3bd2906c-90b3-4d5a-a462-e524f3cb439c</uuid>
Nov 22 16:47:19 user nova-compute[75734]:   <name>instance-00000033</name>
Nov 22 16:47:19 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:47:19 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:47:19 user nova-compute[75734]:   <metadata>
Nov 22 16:47:19 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:47:19 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:47:19 user nova-compute[75734]:       <nova:name>tempest-TestMinimumBasicScenario-server-1864037322</nova:name>
Nov 22 16:47:19 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:47:19</nova:creationTime>
Nov 22 16:47:19 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:47:19 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:47:19 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:47:19 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:47:19 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:47:19 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:47:19 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:47:19 user nova-compute[75734]:       <nova:owner>
Nov 22 16:47:19 user nova-compute[75734]:         <nova:user uuid="6de85c2198a7410291259103e38c5202">tempest-TestMinimumBasicScenario-1450639333-project-member</nova:user>
Nov 22 16:47:19 user nova-compute[75734]:         <nova:project uuid="7f475755bff84214abb76484eb3c2c1d">tempest-TestMinimumBasicScenario-1450639333</nova:project>
Nov 22 16:47:19 user nova-compute[75734]:       </nova:owner>
Nov 22 16:47:19 user nova-compute[75734]:       <nova:root type="image" uuid="79c53300-e61c-41ee-862f-a2f8be158bae"/>
Nov 22 16:47:19 user nova-compute[75734]:       <nova:ports>
Nov 22 16:47:19 user nova-compute[75734]:         <nova:port uuid="a55d32bf-7fda-466a-a065-b21a9ce4a9da">
Nov 22 16:47:19 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:47:19 user nova-compute[75734]:         </nova:port>
Nov 22 16:47:19 user nova-compute[75734]:       </nova:ports>
Nov 22 16:47:19 user nova-compute[75734]:     </nova:instance>
Nov 22 16:47:19 user nova-compute[75734]:   </metadata>
Nov 22 16:47:19 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:47:19 user nova-compute[75734]:     <system>
Nov 22 16:47:19 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:47:19 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:47:19 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:47:19 user nova-compute[75734]:       <entry name="serial">3bd2906c-90b3-4d5a-a462-e524f3cb439c</entry>
Nov 22 16:47:19 user nova-compute[75734]:       <entry name="uuid">3bd2906c-90b3-4d5a-a462-e524f3cb439c</entry>
Nov 22 16:47:19 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:47:19 user nova-compute[75734]:     </system>
Nov 22 16:47:19 user nova-compute[75734]:   </sysinfo>
Nov 22 16:47:19 user nova-compute[75734]:   <os>
Nov 22 16:47:19 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:47:19 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:47:19 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:47:19 user nova-compute[75734]:   </os>
Nov 22 16:47:19 user nova-compute[75734]:   <features>
Nov 22 16:47:19 user nova-compute[75734]:     <acpi/>
Nov 22 16:47:19 user nova-compute[75734]:     <apic/>
Nov 22 16:47:19 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:47:19 user nova-compute[75734]:   </features>
Nov 22 16:47:19 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:47:19 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:47:19 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:47:19 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:47:19 user nova-compute[75734]:   </clock>
Nov 22 16:47:19 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:47:19 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:47:19 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:47:19 user nova-compute[75734]:   </cpu>
Nov 22 16:47:19 user nova-compute[75734]:   <devices>
Nov 22 16:47:19 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:47:19 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:47:19 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk"/>
Nov 22 16:47:19 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:47:19 user nova-compute[75734]:     </disk>
Nov 22 16:47:19 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:47:19 user nova-compute[75734]:       <mac address="fa:16:3e:de:03:c2"/>
Nov 22 16:47:19 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:47:19 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:47:19 user nova-compute[75734]:       <target dev="tapa55d32bf-7f"/>
Nov 22 16:47:19 user nova-compute[75734]:     </interface>
Nov 22 16:47:19 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:47:19 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/console.log" append="off"/>
Nov 22 16:47:19 user nova-compute[75734]:     </serial>
Nov 22 16:47:19 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:47:19 user nova-compute[75734]:     <video>
Nov 22 16:47:19 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:47:19 user nova-compute[75734]:     </video>
Nov 22 16:47:19 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:47:19 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:47:19 user nova-compute[75734]:     </rng>
Nov 22 16:47:19 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:47:19 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:47:19 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:47:19 user nova-compute[75734]:     </memballoon>
Nov 22 16:47:19 user nova-compute[75734]:   </devices>
Nov 22 16:47:19 user nova-compute[75734]: </domain>
Nov 22 16:47:19 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1864037322',display_name='tempest-TestMinimumBasicScenario-server-1864037322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1864037322',id=51,image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHddBir0/WXJGNbmSoUQnNIpKWFeV8uM/Gg5q8i3I9NdDv5prXDWIwglAl+p9kdTGtb4TAnRWN5LJptRMALiQqTi8h3AJhxqns+YyNK/eI0driKKf2iLraF3RmtTGgaUNA==',key_name='tempest-TestMinimumBasicScenario-743959776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-10jvoz2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:47:17Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=3bd2906c-90b3-4d5a-a462-e524f3cb439c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG os_vif [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28697e88-e920-5629-b769-888cfec3e8e6', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa55d32bf-7f, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa55d32bf-7f, col_values=(('qos', UUID('05e0aba1-6016-4701-9920-4685c77c08da')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa55d32bf-7f, col_values=(('external_ids', {'iface-id': 'a55d32bf-7fda-466a-a065-b21a9ce4a9da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:03:c2', 'vm-uuid': '3bd2906c-90b3-4d5a-a462-e524f3cb439c'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:19 user nova-compute[75734]: INFO os_vif [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f')
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No VIF found with MAC fa:16:3e:de:03:c2, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated VIF entry in instance network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:47:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2de8fdbe-555d-4605-84e5-1f0c6a81ccbe req-2ed904ff-5326-4620-a09a-4a52290a2613 service nova] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:47:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-7675c804-66d6-429f-8768-89e2c2ca9689 req-ad6ffca1-4636-4880-a4de-d7a70edb4e10 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:47:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7675c804-66d6-429f-8768-89e2c2ca9689 req-ad6ffca1-4636-4880-a4de-d7a70edb4e10 service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7675c804-66d6-429f-8768-89e2c2ca9689 req-ad6ffca1-4636-4880-a4de-d7a70edb4e10 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:21 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-7675c804-66d6-429f-8768-89e2c2ca9689 req-ad6ffca1-4636-4880-a4de-d7a70edb4e10 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:21 user nova-compute[75734]: DEBUG nova.compute.manager [req-7675c804-66d6-429f-8768-89e2c2ca9689 req-ad6ffca1-4636-4880-a4de-d7a70edb4e10 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:47:21 user nova-compute[75734]: WARNING nova.compute.manager [req-7675c804-66d6-429f-8768-89e2c2ca9689 req-ad6ffca1-4636-4880-a4de-d7a70edb4e10 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received unexpected event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with vm_state building and task_state spawning.
Nov 22 16:47:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:21 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:47:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance spawned successfully.
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-6ff48667-bd92-4334-9505-8f8310fefa47 req-3ddf6eb8-ffd0-494d-b1a9-c883f8e8705d service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6ff48667-bd92-4334-9505-8f8310fefa47 req-3ddf6eb8-ffd0-494d-b1a9-c883f8e8705d service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6ff48667-bd92-4334-9505-8f8310fefa47 req-3ddf6eb8-ffd0-494d-b1a9-c883f8e8705d service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-6ff48667-bd92-4334-9505-8f8310fefa47 req-3ddf6eb8-ffd0-494d-b1a9-c883f8e8705d service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-6ff48667-bd92-4334-9505-8f8310fefa47 req-3ddf6eb8-ffd0-494d-b1a9-c883f8e8705d service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:47:23 user nova-compute[75734]: WARNING nova.compute.manager [req-6ff48667-bd92-4334-9505-8f8310fefa47 req-3ddf6eb8-ffd0-494d-b1a9-c883f8e8705d service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received unexpected event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with vm_state building and task_state spawning.
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:47:23 user nova-compute[75734]: INFO nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 22 16:47:23 user nova-compute[75734]: DEBUG nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:47:23 user nova-compute[75734]: INFO nova.compute.manager [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Took 6.55 seconds to build instance.
Nov 22 16:47:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-5e1a40c2-f668-4f8e-8fbe-57921fa740a5 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.640s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:26 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:27 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:47:27 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:47:27 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9139MB free_disk=24.910545349121094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:47:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:47:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:47:33 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:34 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:47:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:47:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:47:40 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:47:40 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:47:40 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:47:41 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:47:41 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:47:41 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:47:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:47:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:47:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:48:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:48:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:48:28 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:48:29 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:48:29 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:48:29 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9106MB free_disk=24.882179260253906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:30 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:48:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:34 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:48:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:48:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:48:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:48:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:48:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:48:42 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:48:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:48:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:48:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:48:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:48:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:48:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:48:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:48:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:48:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:49:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:49:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG nova.objects.instance [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'flavor' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:10 user nova-compute[75734]: INFO nova.compute.manager [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Attaching volume 489db54c-0675-44c8-b3dd-382ad5d10e69 to /dev/vdb
Nov 22 16:49:10 user nova-compute[75734]: DEBUG os_brick.utils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[593a572e-67e5-4ee2-9940-a73491ec84f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c8ce67-c18d-43de-bb3f-d9884813f58f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc646689-f83f-4b97-8c85-295bccb6cda5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeff947-282c-48ac-8a2a-58144132e583]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:49:10 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:49:10 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6fb0ab-f5cf-47c8-9c35-85bf7357f63e]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:49:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:49:11 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:49:11 user nova-compute[75734]: DEBUG os_brick.utils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:49:11 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating existing volume attachment record: 77f3ad83-d15e-4314-bf12-8654b5336c02 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:49:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdSMfWik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:49:16 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:49:16 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:49:16 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa9500f-28f5-4023-801c-4602aadef80e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:49:16 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44e630d-f59a-48e2-88d8-4153b788dfe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69] added
Nov 22 16:49:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2684834-efdf-4735-99cb-a7615b61f14e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc21279-38e6-4c59-aa4e-60afcc34bc85]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdSMfWik {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdSMfWik" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[917b340b-dbce-49e5-8661-ca6146121286]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zdSMfWik'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac4a6f-3eed-42e0-830d-25e139fb32c8]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de67695-30c4-4b8f-b123-b5a149ad90c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:49:16 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:49:16 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:49:16 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:49:16 user nova-compute[75734]: 
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a1d9c-ddc4-4b8f-a740-e81ff82bd32e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]
Nov 22 16:49:16 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.
Nov 22 16:49:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b977d0-edc5-4ef7-a47d-43f70eeb18ce]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1d158-5cb8-48b1-8e43-dfa0d1dd4bc5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:49:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:49:16 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a783891-6b20-4d11-b07f-ce80e9fcdaa4]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:16 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:49:17 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:49:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdSMfWik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:49:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:49:17 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23365356137653562', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:49:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365356137653562', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:49:17 user nova-compute[75734]: DEBUG nova.objects.instance [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'flavor' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:17 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:49:17 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:49:17 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:49:17 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:49:17 user nova-compute[75734]:   <serial>489db54c-0675-44c8-b3dd-382ad5d10e69</serial>
Nov 22 16:49:17 user nova-compute[75734]: </disk>
Nov 22 16:49:17 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:49:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:49:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:49:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No VIF found with MAC fa:16:3e:de:03:c2, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:49:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-077f3ca3-c003-48bf-a5aa-c77431a5332e tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.664s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:49:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing instance network info cache due to event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated VIF entry in instance network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4637c611-c764-4411-aeec-1ef5b2f3069a req-af4bc73b-0998-44e8-8a01-59b77800715b service nova] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:49:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:49:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing instance network info cache due to event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:49:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:49:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:49:26 user nova-compute[75734]: DEBUG nova.network.neutron [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:49:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated VIF entry in instance network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:49:27 user nova-compute[75734]: DEBUG nova.network.neutron [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:49:27 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-9478c642-64de-4198-ae55-37101d18cd7a req-e1346e8c-3d76-44be-9b06-b2f592670314 service nova] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:49:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:30 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:30 user nova-compute[75734]: INFO nova.compute.manager [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Rebooting instance
Nov 22 16:49:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.network.neutron [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:49:31 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:49:31 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=24.880908966064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.network.neutron [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG nova.compute.manager [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:31 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:32 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance destroyed successfully.
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.objects.instance [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'resources' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1864037322',display_name='tempest-TestMinimumBasicScenario-server-1864037322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1864037322',id=51,image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHddBir0/WXJGNbmSoUQnNIpKWFeV8uM/Gg5q8i3I9NdDv5prXDWIwglAl+p9kdTGtb4TAnRWN5LJptRMALiQqTi8h3AJhxqns+YyNK/eI0driKKf2iLraF3RmtTGgaUNA==',key_name='tempest-TestMinimumBasicScenario-743959776',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-10jvoz2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:49:32Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=3bd2906c-90b3-4d5a-a462-e524f3cb439c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_vif [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa55d32bf-7f, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05e0aba1-6016-4701-9920-4685c77c08da) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:32 user nova-compute[75734]: INFO os_vif [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f')
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdSMfWik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:49:32 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cfaf80-dafa-4624-bab0-c903d4439002]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:49:32 user nova-compute[75734]: No targets found.
Nov 22 16:49:32 user nova-compute[75734]: iSNS:
Nov 22 16:49:32 user nova-compute[75734]: No targets found.
Nov 22 16:49:32 user nova-compute[75734]: STATIC:
Nov 22 16:49:32 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69
Nov 22 16:49:32 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:49:32 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:49:32 user nova-compute[75734]: FIRMWARE:
Nov 22 16:49:32 user nova-compute[75734]: No targets found.
Nov 22 16:49:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:49:32 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:49:32 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d86cc-bc0e-4f3e-a8f6-a57007be41a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4654301f-4227-42be-b3e0-4efe6f9c5196]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:49:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:49:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ecc207760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed59a007-9a1a-4a03-962e-c4ba1d05a59f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97b1ff9-cb72-43b8-bc46-a9261b7ed17a]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a5f75-e990-4c95-adeb-7e4626b53d2e]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddf2590-4b8b-4c2c-ace4-aae24f2123ea]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aa6e32-8cef-4e46-b73d-726ab22ff928]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5253366e-99ba-451c-a8ae-c15fd061796a]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]
Nov 22 16:49:32 user nova-compute[75734]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.
Nov 22 16:49:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5484c4a1-e026-4aac-9878-9fed04b79d47]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== disconnect_volume: return (274ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Start _get_guest_xml network_info=[{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79c53300-e61c-41ee-862f-a2f8be158bae,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '79c53300-e61c-41ee-862f-a2f8be158bae'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '77f3ad83-d15e-4314-bf12-8654b5336c02', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdSMfWik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3bd2906c-90b3-4d5a-a462-e524f3cb439c', 'attached_at': '', 'detached_at': '', 'volume_id': '489db54c-0675-44c8-b3dd-382ad5d10e69', 'serial': '489db54c-0675-44c8-b3dd-382ad5d10e69'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:49:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:49:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79c53300-e61c-41ee-862f-a2f8be158bae,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.objects.instance [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.objects.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Object Instance<3bd2906c-90b3-4d5a-a462-e524f3cb439c> lazy-loaded attributes: resources,vcpu_model {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdSMfWik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:49:32 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:49:32 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:49:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:49:32 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:49:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3555526-bff0-4da6-8714-a28278f2413e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:49:33 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfef811a-b77a-4317-8e4b-b9e119a19d57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69] added
Nov 22 16:49:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d649b3ab-704a-46d8-91ee-486e7fef088c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca8a8a1-c305-4b85-9148-8a39a4c9c438]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdSMfWik {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb21079b-ce9c-40ac-98b4-b759cad911fa req-17224795-990a-4783-ba25-e73c6a14806a service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-unplugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb21079b-ce9c-40ac-98b4-b759cad911fa req-17224795-990a-4783-ba25-e73c6a14806a service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb21079b-ce9c-40ac-98b4-b759cad911fa req-17224795-990a-4783-ba25-e73c6a14806a service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-bb21079b-ce9c-40ac-98b4-b759cad911fa req-17224795-990a-4783-ba25-e73c6a14806a service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG nova.compute.manager [req-bb21079b-ce9c-40ac-98b4-b759cad911fa req-17224795-990a-4783-ba25-e73c6a14806a service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-unplugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:49:33 user nova-compute[75734]: WARNING nova.compute.manager [req-bb21079b-ce9c-40ac-98b4-b759cad911fa req-17224795-990a-4783-ba25-e73c6a14806a service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received unexpected event network-vif-unplugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with vm_state active and task_state reboot_started_hard.
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdSMfWik" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3015bb-85a3-4ac9-bad0-90a12d67ae56]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zdSMfWik'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed2bac4-184f-4731-876c-93ce453d1ec2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e6ebe-635c-449a-8c6e-2570eaa923c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:49:33 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:49:33 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:49:33 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:49:33 user nova-compute[75734]: 
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b162af4c-cd13-42b1-9cc2-819d1087cce1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]
Nov 22 16:49:33 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.
Nov 22 16:49:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[7370f412-e89f-4402-a1ca-2f27d0fe26c7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4df039a-9b5e-4d67-b950-e4f15cf85645]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:49:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:49:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[11426153-8a92-4a94-87d7-18a4fda3ab35]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:49:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdSMfWik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23365356137653562', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365356137653562', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1864037322',display_name='tempest-TestMinimumBasicScenario-server-1864037322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1864037322',id=51,image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHddBir0/WXJGNbmSoUQnNIpKWFeV8uM/Gg5q8i3I9NdDv5prXDWIwglAl+p9kdTGtb4TAnRWN5LJptRMALiQqTi8h3AJhxqns+YyNK/eI0driKKf2iLraF3RmtTGgaUNA==',key_name='tempest-TestMinimumBasicScenario-743959776',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-10jvoz2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:49:32Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=3bd2906c-90b3-4d5a-a462-e524f3cb439c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.objects.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Object Instance<3bd2906c-90b3-4d5a-a462-e524f3cb439c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:49:34 user nova-compute[75734]:   <uuid>3bd2906c-90b3-4d5a-a462-e524f3cb439c</uuid>
Nov 22 16:49:34 user nova-compute[75734]:   <name>instance-00000033</name>
Nov 22 16:49:34 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:49:34 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:49:34 user nova-compute[75734]:   <metadata>
Nov 22 16:49:34 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:49:34 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:49:34 user nova-compute[75734]:       <nova:name>tempest-TestMinimumBasicScenario-server-1864037322</nova:name>
Nov 22 16:49:34 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:49:32</nova:creationTime>
Nov 22 16:49:34 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:49:34 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:49:34 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:49:34 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:49:34 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:49:34 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:49:34 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:49:34 user nova-compute[75734]:       <nova:owner>
Nov 22 16:49:34 user nova-compute[75734]:         <nova:user uuid="6de85c2198a7410291259103e38c5202">tempest-TestMinimumBasicScenario-1450639333-project-member</nova:user>
Nov 22 16:49:34 user nova-compute[75734]:         <nova:project uuid="7f475755bff84214abb76484eb3c2c1d">tempest-TestMinimumBasicScenario-1450639333</nova:project>
Nov 22 16:49:34 user nova-compute[75734]:       </nova:owner>
Nov 22 16:49:34 user nova-compute[75734]:       <nova:root type="image" uuid="79c53300-e61c-41ee-862f-a2f8be158bae"/>
Nov 22 16:49:34 user nova-compute[75734]:       <nova:ports>
Nov 22 16:49:34 user nova-compute[75734]:         <nova:port uuid="a55d32bf-7fda-466a-a065-b21a9ce4a9da">
Nov 22 16:49:34 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 16:49:34 user nova-compute[75734]:         </nova:port>
Nov 22 16:49:34 user nova-compute[75734]:       </nova:ports>
Nov 22 16:49:34 user nova-compute[75734]:     </nova:instance>
Nov 22 16:49:34 user nova-compute[75734]:   </metadata>
Nov 22 16:49:34 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:49:34 user nova-compute[75734]:     <system>
Nov 22 16:49:34 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:49:34 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:49:34 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:49:34 user nova-compute[75734]:       <entry name="serial">3bd2906c-90b3-4d5a-a462-e524f3cb439c</entry>
Nov 22 16:49:34 user nova-compute[75734]:       <entry name="uuid">3bd2906c-90b3-4d5a-a462-e524f3cb439c</entry>
Nov 22 16:49:34 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:49:34 user nova-compute[75734]:     </system>
Nov 22 16:49:34 user nova-compute[75734]:   </sysinfo>
Nov 22 16:49:34 user nova-compute[75734]:   <os>
Nov 22 16:49:34 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:49:34 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:49:34 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:49:34 user nova-compute[75734]:   </os>
Nov 22 16:49:34 user nova-compute[75734]:   <features>
Nov 22 16:49:34 user nova-compute[75734]:     <acpi/>
Nov 22 16:49:34 user nova-compute[75734]:     <apic/>
Nov 22 16:49:34 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:49:34 user nova-compute[75734]:   </features>
Nov 22 16:49:34 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:49:34 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:49:34 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:49:34 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:49:34 user nova-compute[75734]:   </clock>
Nov 22 16:49:34 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:49:34 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:49:34 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:49:34 user nova-compute[75734]:   </cpu>
Nov 22 16:49:34 user nova-compute[75734]:   <devices>
Nov 22 16:49:34 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:49:34 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:49:34 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk"/>
Nov 22 16:49:34 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:49:34 user nova-compute[75734]:     </disk>
Nov 22 16:49:34 user nova-compute[75734]:     <disk type="block" device="disk">
Nov 22 16:49:34 user nova-compute[75734]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:49:34 user nova-compute[75734]:       <source dev="/dev/sdb"/>
Nov 22 16:49:34 user nova-compute[75734]:       <target dev="vdb" bus="virtio"/>
Nov 22 16:49:34 user nova-compute[75734]:       <serial>489db54c-0675-44c8-b3dd-382ad5d10e69</serial>
Nov 22 16:49:34 user nova-compute[75734]:     </disk>
Nov 22 16:49:34 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:49:34 user nova-compute[75734]:       <mac address="fa:16:3e:de:03:c2"/>
Nov 22 16:49:34 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:49:34 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:49:34 user nova-compute[75734]:       <target dev="tapa55d32bf-7f"/>
Nov 22 16:49:34 user nova-compute[75734]:     </interface>
Nov 22 16:49:34 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:49:34 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/console.log" append="off"/>
Nov 22 16:49:34 user nova-compute[75734]:     </serial>
Nov 22 16:49:34 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:49:34 user nova-compute[75734]:     <video>
Nov 22 16:49:34 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:49:34 user nova-compute[75734]:     </video>
Nov 22 16:49:34 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:49:34 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:49:34 user nova-compute[75734]:     </rng>
Nov 22 16:49:34 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:49:34 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:49:34 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:49:34 user nova-compute[75734]:     </memballoon>
Nov 22 16:49:34 user nova-compute[75734]:   </devices>
Nov 22 16:49:34 user nova-compute[75734]: </domain>
Nov 22 16:49:34 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.objects.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Object Instance<3bd2906c-90b3-4d5a-a462-e524f3cb439c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c87d3711784af7a1e7eab1d7f582f9e03f92664 --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:49:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Cannot resize image /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.objects.instance [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'migration_context' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.objects.base [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Object Instance<3bd2906c-90b3-4d5a-a462-e524f3cb439c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75734) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1864037322',display_name='tempest-TestMinimumBasicScenario-server-1864037322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1864037322',id=51,image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHddBir0/WXJGNbmSoUQnNIpKWFeV8uM/Gg5q8i3I9NdDv5prXDWIwglAl+p9kdTGtb4TAnRWN5LJptRMALiQqTi8h3AJhxqns+YyNK/eI0driKKf2iLraF3RmtTGgaUNA==',key_name='tempest-TestMinimumBasicScenario-743959776',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-10jvoz2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:49:32Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=3bd2906c-90b3-4d5a-a462-e524f3cb439c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG os_vif [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28697e88-e920-5629-b769-888cfec3e8e6', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa55d32bf-7f, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa55d32bf-7f, col_values=(('qos', UUID('984aa82d-56db-4bfa-af23-4aa4a5ac9376')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa55d32bf-7f, col_values=(('external_ids', {'iface-id': 'a55d32bf-7fda-466a-a065-b21a9ce4a9da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:03:c2', 'vm-uuid': '3bd2906c-90b3-4d5a-a462-e524f3cb439c'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:35 user nova-compute[75734]: INFO os_vif [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f')
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-42f2948f-2d2e-4798-8c8d-b0d4c247638c req-a4cd3532-6e4e-45c7-8593-caf77f3dc6cb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-42f2948f-2d2e-4798-8c8d-b0d4c247638c req-a4cd3532-6e4e-45c7-8593-caf77f3dc6cb service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-42f2948f-2d2e-4798-8c8d-b0d4c247638c req-a4cd3532-6e4e-45c7-8593-caf77f3dc6cb service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-42f2948f-2d2e-4798-8c8d-b0d4c247638c req-a4cd3532-6e4e-45c7-8593-caf77f3dc6cb service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:35 user nova-compute[75734]: DEBUG nova.compute.manager [req-42f2948f-2d2e-4798-8c8d-b0d4c247638c req-a4cd3532-6e4e-45c7-8593-caf77f3dc6cb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:49:35 user nova-compute[75734]: WARNING nova.compute.manager [req-42f2948f-2d2e-4798-8c8d-b0d4c247638c req-a4cd3532-6e4e-45c7-8593-caf77f3dc6cb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received unexpected event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with vm_state active and task_state reboot_started_hard.
Nov 22 16:49:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:36 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-2c0507ce-55b2-4c33-b597-c4dff437a89a req-87fb9e69-9c41-4e37-882c-eea484af2cf0 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:49:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2c0507ce-55b2-4c33-b597-c4dff437a89a req-87fb9e69-9c41-4e37-882c-eea484af2cf0 service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2c0507ce-55b2-4c33-b597-c4dff437a89a req-87fb9e69-9c41-4e37-882c-eea484af2cf0 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2c0507ce-55b2-4c33-b597-c4dff437a89a req-87fb9e69-9c41-4e37-882c-eea484af2cf0 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:37 user nova-compute[75734]: DEBUG nova.compute.manager [req-2c0507ce-55b2-4c33-b597-c4dff437a89a req-87fb9e69-9c41-4e37-882c-eea484af2cf0 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:49:37 user nova-compute[75734]: WARNING nova.compute.manager [req-2c0507ce-55b2-4c33-b597-c4dff437a89a req-87fb9e69-9c41-4e37-882c-eea484af2cf0 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received unexpected event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with vm_state active and task_state reboot_started_hard.
Nov 22 16:49:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:49:38 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance rebooted successfully.
Nov 22 16:49:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:49:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-12aafee5-ba8f-4537-8c82-45d7607e1c34 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.601s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-308a2287-2011-4a54-a0fb-03b402584566 req-0b84d0f0-6d24-4cc0-acf7-456246b9b211 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:49:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-308a2287-2011-4a54-a0fb-03b402584566 req-0b84d0f0-6d24-4cc0-acf7-456246b9b211 service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:49:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-308a2287-2011-4a54-a0fb-03b402584566 req-0b84d0f0-6d24-4cc0-acf7-456246b9b211 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:49:39 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-308a2287-2011-4a54-a0fb-03b402584566 req-0b84d0f0-6d24-4cc0-acf7-456246b9b211 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:49:39 user nova-compute[75734]: DEBUG nova.compute.manager [req-308a2287-2011-4a54-a0fb-03b402584566 req-0b84d0f0-6d24-4cc0-acf7-456246b9b211 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:49:39 user nova-compute[75734]: WARNING nova.compute.manager [req-308a2287-2011-4a54-a0fb-03b402584566 req-0b84d0f0-6d24-4cc0-acf7-456246b9b211 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received unexpected event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with vm_state active and task_state None.
Nov 22 16:49:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:49:42 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:49:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:49:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:49:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:49:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:49:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:49:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:49:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:49:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:49:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:49:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:49:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:49:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:02 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:07 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:50:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:50:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:50:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:50:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:50:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:50:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=24.871505737304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:50:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:50:33 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:33 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:33 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:50:34 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:50:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:50:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:50:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:50:42 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:50:42 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:50:42 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:50:43 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:50:43 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:50:43 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:50:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:50:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:50:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:50:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Triggering sync for uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 16:50:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:50:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:50:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:50:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:50:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:50:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:50:59 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:51:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:51:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:51:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:51:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG nova.compute.manager [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing instance network info cache due to event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated VIF entry in instance network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG nova.network.neutron [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:51:23 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2efe9f40-b06b-47c5-aa13-49fd1d000b10 req-22f18b68-556a-4b85-9d86-477fdfb44110 service nova] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing instance network info cache due to event network-changed-a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Refreshing network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:51:24 user nova-compute[75734]: INFO nova.compute.manager [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Detaching volume 489db54c-0675-44c8-b3dd-382ad5d10e69
Nov 22 16:51:24 user nova-compute[75734]: INFO nova.virt.block_device [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Attempting to driver detach volume 489db54c-0675-44c8-b3dd-382ad5d10e69 from mountpoint /dev/vdb
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Attempting to detach device vdb from instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:51:24 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:51:24 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:51:24 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:51:24 user nova-compute[75734]:   <serial>489db54c-0675-44c8-b3dd-382ad5d10e69</serial>
Nov 22 16:51:24 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:51:24 user nova-compute[75734]: </disk>
Nov 22 16:51:24 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:51:24 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully detached device vdb from instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c from the persistent domain config.
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:51:24 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:51:24 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:51:24 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:51:24 user nova-compute[75734]:   <serial>489db54c-0675-44c8-b3dd-382ad5d10e69</serial>
Nov 22 16:51:24 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 16:51:24 user nova-compute[75734]: </disk>
Nov 22 16:51:24 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated VIF entry in instance network info cache for port a55d32bf-7fda-466a-a065-b21a9ce4a9da. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.network.neutron [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-01dbbb0c-fc4f-4ef3-b587-1b7d7fc824a5 req-05986b66-1f89-43fa-a2cc-706fe301abbb service nova] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:51:24 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:51:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:31 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:51:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:51:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=24.870742797851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:51:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:35 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:51:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:39 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:51:44 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c is timed out.
Nov 22 16:51:44 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully detached device vdb from instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c from the live domain config.
Nov 22 16:51:44 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdSMfWik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:51:44 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:51:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf03b7d-2c8b-4f60-baa0-83ae66a110a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:51:44 user nova-compute[75734]: No targets found.
Nov 22 16:51:44 user nova-compute[75734]: iSNS:
Nov 22 16:51:44 user nova-compute[75734]: No targets found.
Nov 22 16:51:44 user nova-compute[75734]: STATIC:
Nov 22 16:51:44 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69
Nov 22 16:51:44 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:51:44 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:51:44 user nova-compute[75734]: FIRMWARE:
Nov 22 16:51:44 user nova-compute[75734]: No targets found.
Nov 22 16:51:44 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:51:44 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:51:44 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:51:44 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166eefd-0c04-441f-971f-274cfe9d7715]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a47d53a-f4a1-4b23-9cc9-7abaa745a90a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:51:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 (non-flash)
Nov 22 16:51:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac422050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c16703b-c63a-4cef-81fa-c6bd4e3b3bae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c382ef-17cb-49a1-82b7-7841c937e37b]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[75df6379-46b5-488e-8514-4234f186e2c7]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [{"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[53583a8b-0ba2-4864-aabb-5e9bf3d00bb4]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-3bd2906c-90b3-4d5a-a462-e524f3cb439c" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b357466-38d8-4169-85f0-6be2c5006c67]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa4b339-8751-4e22-8e3f-b7e4eb051233]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260]
Nov 22 16:51:45 user nova-compute[75734]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69, portal: 172.16.0.220,3260] successful.
Nov 22 16:51:45 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489db54c-0675-44c8-b3dd-382ad5d10e69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe11c0-d845-4fc3-9bf0-1f7da267a71d]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== disconnect_volume: return (295ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:51:45 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:51:46 user nova-compute[75734]: DEBUG nova.objects.instance [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'flavor' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:51:46 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-4a422c7f-2c68-4b79-85b8-fb578d221311 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.688s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:51:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:51:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:51:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:52:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:52:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:52:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:52:18 user nova-compute[75734]: INFO nova.compute.manager [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Terminating instance
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-f2c9d9b3-e8d4-4ecc-9561-0d0dd5a212ca req-97ee545b-55e2-4ee8-baf9-178007651c03 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-unplugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f2c9d9b3-e8d4-4ecc-9561-0d0dd5a212ca req-97ee545b-55e2-4ee8-baf9-178007651c03 service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f2c9d9b3-e8d4-4ecc-9561-0d0dd5a212ca req-97ee545b-55e2-4ee8-baf9-178007651c03 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-f2c9d9b3-e8d4-4ecc-9561-0d0dd5a212ca req-97ee545b-55e2-4ee8-baf9-178007651c03 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-f2c9d9b3-e8d4-4ecc-9561-0d0dd5a212ca req-97ee545b-55e2-4ee8-baf9-178007651c03 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-unplugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-f2c9d9b3-e8d4-4ecc-9561-0d0dd5a212ca req-97ee545b-55e2-4ee8-baf9-178007651c03 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-unplugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:52:18 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Instance destroyed successfully.
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.objects.instance [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'resources' on Instance uuid 3bd2906c-90b3-4d5a-a462-e524f3cb439c {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1864037322',display_name='tempest-TestMinimumBasicScenario-server-1864037322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1864037322',id=51,image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHddBir0/WXJGNbmSoUQnNIpKWFeV8uM/Gg5q8i3I9NdDv5prXDWIwglAl+p9kdTGtb4TAnRWN5LJptRMALiQqTi8h3AJhxqns+YyNK/eI0driKKf2iLraF3RmtTGgaUNA==',key_name='tempest-TestMinimumBasicScenario-743959776',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-10jvoz2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79c53300-e61c-41ee-862f-a2f8be158bae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:49:39Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=3bd2906c-90b3-4d5a-a462-e524f3cb439c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "address": "fa:16:3e:de:03:c2", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55d32bf-7f", "ovs_interfaceid": "a55d32bf-7fda-466a-a065-b21a9ce4a9da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG os_vif [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa55d32bf-7f, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=984aa82d-56db-4bfa-af23-4aa4a5ac9376) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:18 user nova-compute[75734]: INFO os_vif [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:03:c2,bridge_name='br-int',has_traffic_filtering=True,id=a55d32bf-7fda-466a-a065-b21a9ce4a9da,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55d32bf-7f')
Nov 22 16:52:18 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Deleting instance files /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c_del
Nov 22 16:52:18 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Deletion of /opt/stack/data/nova/instances/3bd2906c-90b3-4d5a-a462-e524f3cb439c_del complete
Nov 22 16:52:18 user nova-compute[75734]: INFO nova.compute.manager [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 22 16:52:18 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:52:18 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:52:19 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:52:19 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Took 0.48 seconds to deallocate network for instance.
Nov 22 16:52:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:52:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:52:19 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:52:19 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:52:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:52:19 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Deleted allocations for instance 3bd2906c-90b3-4d5a-a462-e524f3cb439c
Nov 22 16:52:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-ea417c6a-b797-494a-9ee2-bd1aa70af1fc tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.727s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:52:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-539bf7e6-6e81-406f-9199-de098cfc5e48 req-8302ae19-4cb7-4dfc-9764-192d566b1fc4 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:52:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-539bf7e6-6e81-406f-9199-de098cfc5e48 req-8302ae19-4cb7-4dfc-9764-192d566b1fc4 service nova] Acquiring lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:52:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-539bf7e6-6e81-406f-9199-de098cfc5e48 req-8302ae19-4cb7-4dfc-9764-192d566b1fc4 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:52:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-539bf7e6-6e81-406f-9199-de098cfc5e48 req-8302ae19-4cb7-4dfc-9764-192d566b1fc4 service nova] Lock "3bd2906c-90b3-4d5a-a462-e524f3cb439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:52:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-539bf7e6-6e81-406f-9199-de098cfc5e48 req-8302ae19-4cb7-4dfc-9764-192d566b1fc4 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] No waiting events found dispatching network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:52:20 user nova-compute[75734]: WARNING nova.compute.manager [req-539bf7e6-6e81-406f-9199-de098cfc5e48 req-8302ae19-4cb7-4dfc-9764-192d566b1fc4 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received unexpected event network-vif-plugged-a55d32bf-7fda-466a-a065-b21a9ce4a9da for instance with vm_state deleted and task_state None.
Nov 22 16:52:20 user nova-compute[75734]: DEBUG nova.compute.manager [req-539bf7e6-6e81-406f-9199-de098cfc5e48 req-8302ae19-4cb7-4dfc-9764-192d566b1fc4 service nova] [instance: 3bd2906c-90b3-4d5a-a462-e524f3cb439c] Received event network-vif-deleted-a55d32bf-7fda-466a-a065-b21a9ce4a9da {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:52:23 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:28 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:31 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:52:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:52:31 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:52:31 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:52:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:52:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:52:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9210MB free_disk=24.898029327392578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:52:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:52:33 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:36 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:52:38 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:43 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:46 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:52:46 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:52:46 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:52:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:52:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:52:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:52:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:52:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:52:48 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:53 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:52:58 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:53:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:53:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:53:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:53:03 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Starting instance... {{(pid=75734) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75734) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 16:53:12 user nova-compute[75734]: INFO nova.compute.claims [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Claim successful on node user
Nov 22 16:53:12 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Start building networks asynchronously for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Allocating IP information in the background. {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 16:53:12 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] allocate_for_instance() {{(pid=75734) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 16:53:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 16:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Start building block device mappings for instance. {{(pid=75734) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG nova.policy [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6de85c2198a7410291259103e38c5202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f475755bff84214abb76484eb3c2c1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75734) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Start spawning the instance on the hypervisor. {{(pid=75734) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Creating instance directory {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 16:53:13 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Creating image(s)
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "/opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "/opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "/opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "d48998e688f7b85c62bb159ff95317315086dcf6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "d48998e688f7b85c62bb159ff95317315086dcf6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.part --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Successfully created port: 0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG nova.virt.images [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] 7bec2ab1-5967-4c09-b614-58a166860f90 was qcow2, converting to raw {{(pid=75734) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG nova.privsep.utils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75734) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.part /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.converted {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.part /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.converted" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:13 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.converted --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6.converted --force-share --output=json" returned: 0 in 0.333s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "d48998e688f7b85c62bb159ff95317315086dcf6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.127s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6 --force-share --output=json" returned: 0 in 0.194s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "d48998e688f7b85c62bb159ff95317315086dcf6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "d48998e688f7b85c62bb159ff95317315086dcf6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Successfully updated port: 0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG nova.compute.manager [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing instance network info cache due to event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6,backing_fmt=raw /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk 1073741824 {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance cache missing network info. {{(pid=75734) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6,backing_fmt=raw /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk 1073741824" returned: 0 in 0.057s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "d48998e688f7b85c62bb159ff95317315086dcf6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6 --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d48998e688f7b85c62bb159ff95317315086dcf6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk. size=1073741824 {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 16:53:14 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.neutron [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance network_info: |[{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75734) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.disk.api [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Cannot resize image /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk to a smaller size. {{(pid=75734) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Created local disks {{(pid=75734) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Ensure instance console log exists: /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/console.log {{(pid=75734) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Start _get_guest_xml network_info=[{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T16:53:10Z,direct_url=<?>,disk_format='qcow2',id=7bec2ab1-5967-4c09-b614-58a166860f90,min_disk=0,min_ram=0,name='tempest-scenario-img--762888496',owner='7f475755bff84214abb76484eb3c2c1d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T16:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7bec2ab1-5967-4c09-b614-58a166860f90'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 16:53:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:53:15 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU controller missing on host. {{(pid=75734) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.host [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU controller found on host. {{(pid=75734) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75734) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T15:48:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T16:53:10Z,direct_url=<?>,disk_format='qcow2',id=7bec2ab1-5967-4c09-b614-58a166860f90,min_disk=0,min_ram=0,name='tempest-scenario-img--762888496',owner='7f475755bff84214abb76484eb3c2c1d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T16:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flavor limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Image limits 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flavor pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Image pref 0:0:0 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75734) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Got 1 possible topologies {{(pid=75734) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.hardware [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75734) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-14611227',display_name='tempest-TestMinimumBasicScenario-server-14611227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-14611227',id=52,image_ref='7bec2ab1-5967-4c09-b614-58a166860f90',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv8w6ruGJObwWc0q6dSYSsq11RgssbgIFm9K1lRc8nzW1XZzprANAmKCSERaM4pz9MGTTZssGdnPc7NtDGjI1HTknmqn5KemI/0QvlFMm1fjQATzum5kAPdC5I64wKbyQ==',key_name='tempest-TestMinimumBasicScenario-1206244178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-u808znl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7bec2ab1-5967-4c09-b614-58a166860f90',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:53:13Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=15db7a53-0a04-485e-824c-bc6bd3d2d5ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75734) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:00:72,bridge_name='br-int',has_traffic_filtering=True,id=0ad71c1f-fa25-4b11-a994-9da8cd84249d,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad71c1f-fa') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.objects.instance [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'pci_devices' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] End _get_guest_xml xml=<domain type="kvm">
Nov 22 16:53:15 user nova-compute[75734]:   <uuid>15db7a53-0a04-485e-824c-bc6bd3d2d5ba</uuid>
Nov 22 16:53:15 user nova-compute[75734]:   <name>instance-00000034</name>
Nov 22 16:53:15 user nova-compute[75734]:   <memory>524288</memory>
Nov 22 16:53:15 user nova-compute[75734]:   <vcpu>1</vcpu>
Nov 22 16:53:15 user nova-compute[75734]:   <metadata>
Nov 22 16:53:15 user nova-compute[75734]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 16:53:15 user nova-compute[75734]:       <nova:package version="0.0.0"/>
Nov 22 16:53:15 user nova-compute[75734]:       <nova:name>tempest-TestMinimumBasicScenario-server-14611227</nova:name>
Nov 22 16:53:15 user nova-compute[75734]:       <nova:creationTime>2023-11-22 16:53:15</nova:creationTime>
Nov 22 16:53:15 user nova-compute[75734]:       <nova:flavor name="m1.tiny">
Nov 22 16:53:15 user nova-compute[75734]:         <nova:memory>512</nova:memory>
Nov 22 16:53:15 user nova-compute[75734]:         <nova:disk>1</nova:disk>
Nov 22 16:53:15 user nova-compute[75734]:         <nova:swap>0</nova:swap>
Nov 22 16:53:15 user nova-compute[75734]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 16:53:15 user nova-compute[75734]:         <nova:vcpus>1</nova:vcpus>
Nov 22 16:53:15 user nova-compute[75734]:       </nova:flavor>
Nov 22 16:53:15 user nova-compute[75734]:       <nova:owner>
Nov 22 16:53:15 user nova-compute[75734]:         <nova:user uuid="6de85c2198a7410291259103e38c5202">tempest-TestMinimumBasicScenario-1450639333-project-member</nova:user>
Nov 22 16:53:15 user nova-compute[75734]:         <nova:project uuid="7f475755bff84214abb76484eb3c2c1d">tempest-TestMinimumBasicScenario-1450639333</nova:project>
Nov 22 16:53:15 user nova-compute[75734]:       </nova:owner>
Nov 22 16:53:15 user nova-compute[75734]:       <nova:root type="image" uuid="7bec2ab1-5967-4c09-b614-58a166860f90"/>
Nov 22 16:53:15 user nova-compute[75734]:       <nova:ports>
Nov 22 16:53:15 user nova-compute[75734]:         <nova:port uuid="0ad71c1f-fa25-4b11-a994-9da8cd84249d">
Nov 22 16:53:15 user nova-compute[75734]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 16:53:15 user nova-compute[75734]:         </nova:port>
Nov 22 16:53:15 user nova-compute[75734]:       </nova:ports>
Nov 22 16:53:15 user nova-compute[75734]:     </nova:instance>
Nov 22 16:53:15 user nova-compute[75734]:   </metadata>
Nov 22 16:53:15 user nova-compute[75734]:   <sysinfo type="smbios">
Nov 22 16:53:15 user nova-compute[75734]:     <system>
Nov 22 16:53:15 user nova-compute[75734]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 16:53:15 user nova-compute[75734]:       <entry name="product">OpenStack Nova</entry>
Nov 22 16:53:15 user nova-compute[75734]:       <entry name="version">0.0.0</entry>
Nov 22 16:53:15 user nova-compute[75734]:       <entry name="serial">15db7a53-0a04-485e-824c-bc6bd3d2d5ba</entry>
Nov 22 16:53:15 user nova-compute[75734]:       <entry name="uuid">15db7a53-0a04-485e-824c-bc6bd3d2d5ba</entry>
Nov 22 16:53:15 user nova-compute[75734]:       <entry name="family">Virtual Machine</entry>
Nov 22 16:53:15 user nova-compute[75734]:     </system>
Nov 22 16:53:15 user nova-compute[75734]:   </sysinfo>
Nov 22 16:53:15 user nova-compute[75734]:   <os>
Nov 22 16:53:15 user nova-compute[75734]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 16:53:15 user nova-compute[75734]:     <boot dev="hd"/>
Nov 22 16:53:15 user nova-compute[75734]:     <smbios mode="sysinfo"/>
Nov 22 16:53:15 user nova-compute[75734]:   </os>
Nov 22 16:53:15 user nova-compute[75734]:   <features>
Nov 22 16:53:15 user nova-compute[75734]:     <acpi/>
Nov 22 16:53:15 user nova-compute[75734]:     <apic/>
Nov 22 16:53:15 user nova-compute[75734]:     <vmcoreinfo/>
Nov 22 16:53:15 user nova-compute[75734]:   </features>
Nov 22 16:53:15 user nova-compute[75734]:   <clock offset="utc">
Nov 22 16:53:15 user nova-compute[75734]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 16:53:15 user nova-compute[75734]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 16:53:15 user nova-compute[75734]:     <timer name="hpet" present="no"/>
Nov 22 16:53:15 user nova-compute[75734]:   </clock>
Nov 22 16:53:15 user nova-compute[75734]:   <cpu mode="custom" match="exact">
Nov 22 16:53:15 user nova-compute[75734]:     <model>Nehalem</model>
Nov 22 16:53:15 user nova-compute[75734]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 16:53:15 user nova-compute[75734]:   </cpu>
Nov 22 16:53:15 user nova-compute[75734]:   <devices>
Nov 22 16:53:15 user nova-compute[75734]:     <disk type="file" device="disk">
Nov 22 16:53:15 user nova-compute[75734]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 16:53:15 user nova-compute[75734]:       <source file="/opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk"/>
Nov 22 16:53:15 user nova-compute[75734]:       <target dev="vda" bus="virtio"/>
Nov 22 16:53:15 user nova-compute[75734]:     </disk>
Nov 22 16:53:15 user nova-compute[75734]:     <interface type="ethernet">
Nov 22 16:53:15 user nova-compute[75734]:       <mac address="fa:16:3e:21:00:72"/>
Nov 22 16:53:15 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:53:15 user nova-compute[75734]:       <mtu size="1442"/>
Nov 22 16:53:15 user nova-compute[75734]:       <target dev="tap0ad71c1f-fa"/>
Nov 22 16:53:15 user nova-compute[75734]:     </interface>
Nov 22 16:53:15 user nova-compute[75734]:     <serial type="pty">
Nov 22 16:53:15 user nova-compute[75734]:       <log file="/opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/console.log" append="off"/>
Nov 22 16:53:15 user nova-compute[75734]:     </serial>
Nov 22 16:53:15 user nova-compute[75734]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 16:53:15 user nova-compute[75734]:     <video>
Nov 22 16:53:15 user nova-compute[75734]:       <model type="virtio"/>
Nov 22 16:53:15 user nova-compute[75734]:     </video>
Nov 22 16:53:15 user nova-compute[75734]:     <rng model="virtio">
Nov 22 16:53:15 user nova-compute[75734]:       <backend model="random">/dev/urandom</backend>
Nov 22 16:53:15 user nova-compute[75734]:     </rng>
Nov 22 16:53:15 user nova-compute[75734]:     <controller type="usb" index="0" model="none"/>
Nov 22 16:53:15 user nova-compute[75734]:     <memballoon model="virtio">
Nov 22 16:53:15 user nova-compute[75734]:       <stats period="10"/>
Nov 22 16:53:15 user nova-compute[75734]:     </memballoon>
Nov 22 16:53:15 user nova-compute[75734]:   </devices>
Nov 22 16:53:15 user nova-compute[75734]: </domain>
Nov 22 16:53:15 user nova-compute[75734]:  {{(pid=75734) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-14611227',display_name='tempest-TestMinimumBasicScenario-server-14611227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-14611227',id=52,image_ref='7bec2ab1-5967-4c09-b614-58a166860f90',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv8w6ruGJObwWc0q6dSYSsq11RgssbgIFm9K1lRc8nzW1XZzprANAmKCSERaM4pz9MGTTZssGdnPc7NtDGjI1HTknmqn5KemI/0QvlFMm1fjQATzum5kAPdC5I64wKbyQ==',key_name='tempest-TestMinimumBasicScenario-1206244178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-u808znl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7bec2ab1-5967-4c09-b614-58a166860f90',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T16:53:13Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=15db7a53-0a04-485e-824c-bc6bd3d2d5ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:00:72,bridge_name='br-int',has_traffic_filtering=True,id=0ad71c1f-fa25-4b11-a994-9da8cd84249d,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad71c1f-fa') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG os_vif [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:00:72,bridge_name='br-int',has_traffic_filtering=True,id=0ad71c1f-fa25-4b11-a994-9da8cd84249d,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad71c1f-fa') {{(pid=75734) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afb0960b-8b79-5993-a322-bb45af9e849a', '_type': 'linux-noop'}}, row=False) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ad71c1f-fa, may_exist=True, interface_attrs={}) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ad71c1f-fa, col_values=(('qos', UUID('d6e0a45f-0315-426a-847d-e33e57fd7408')),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ad71c1f-fa, col_values=(('external_ids', {'iface-id': '0ad71c1f-fa25-4b11-a994-9da8cd84249d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:00:72', 'vm-uuid': '15db7a53-0a04-485e-824c-bc6bd3d2d5ba'}),), if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:15 user nova-compute[75734]: INFO os_vif [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:00:72,bridge_name='br-int',has_traffic_filtering=True,id=0ad71c1f-fa25-4b11-a994-9da8cd84249d,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad71c1f-fa')
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No VIF found with MAC fa:16:3e:21:00:72, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated VIF entry in instance network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG nova.network.neutron [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:53:15 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-54bc9d1c-1ab7-4ada-94ad-afc6ea97f523 req-693f996f-697b-4bc3-9f72-15a53d06f054 service nova] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-a8ff5937-2369-4538-9fb0-536203957b37 req-81aa0eda-1457-4112-8b5d-ae5e03f86fbe service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a8ff5937-2369-4538-9fb0-536203957b37 req-81aa0eda-1457-4112-8b5d-ae5e03f86fbe service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a8ff5937-2369-4538-9fb0-536203957b37 req-81aa0eda-1457-4112-8b5d-ae5e03f86fbe service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a8ff5937-2369-4538-9fb0-536203957b37 req-81aa0eda-1457-4112-8b5d-ae5e03f86fbe service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:16 user nova-compute[75734]: DEBUG nova.compute.manager [req-a8ff5937-2369-4538-9fb0-536203957b37 req-81aa0eda-1457-4112-8b5d-ae5e03f86fbe service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:53:16 user nova-compute[75734]: WARNING nova.compute.manager [req-a8ff5937-2369-4538-9fb0-536203957b37 req-81aa0eda-1457-4112-8b5d-ae5e03f86fbe service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received unexpected event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with vm_state building and task_state spawning.
Nov 22 16:53:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance event wait completed in 0 seconds for  {{(pid=75734) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Guest created on hypervisor {{(pid=75734) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 16:53:18 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance spawned successfully.
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Found default for hw_cdrom_bus of ide {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Found default for hw_disk_bus of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Found default for hw_input_bus of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Found default for hw_pointer_model of None {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Found default for hw_video_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Found default for hw_vif_model of virtio {{(pid=75734) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 16:53:18 user nova-compute[75734]: INFO nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:53:18 user nova-compute[75734]: INFO nova.compute.manager [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Took 6.10 seconds to build instance.
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-8b53d412-0af9-48af-99d1-bc621469d6ec req-6d0881f8-4f78-465c-baa6-d5b09b682169 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8b53d412-0af9-48af-99d1-bc621469d6ec req-6d0881f8-4f78-465c-baa6-d5b09b682169 service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8b53d412-0af9-48af-99d1-bc621469d6ec req-6d0881f8-4f78-465c-baa6-d5b09b682169 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-8b53d412-0af9-48af-99d1-bc621469d6ec req-6d0881f8-4f78-465c-baa6-d5b09b682169 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:18 user nova-compute[75734]: DEBUG nova.compute.manager [req-8b53d412-0af9-48af-99d1-bc621469d6ec req-6d0881f8-4f78-465c-baa6-d5b09b682169 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:53:18 user nova-compute[75734]: WARNING nova.compute.manager [req-8b53d412-0af9-48af-99d1-bc621469d6ec req-6d0881f8-4f78-465c-baa6-d5b09b682169 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received unexpected event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with vm_state active and task_state None.
Nov 22 16:53:18 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-f229e4b4-0b19-476e-a15e-842c0c608a1a tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.210s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:53:33 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:53:33 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:53:33 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9088MB free_disk=24.849308013916016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:53:33 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:53:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:37 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:38 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:53:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:53:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:53:48 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:53:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:53:48 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:53:48 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:53:48 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:53:49 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:53:49 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:53:49 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:53:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:53:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:54:34 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:35 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:54:35 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9103MB free_disk=24.847030639648438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing inventories for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating ProviderTree inventory for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Updating inventory in ProviderTree for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing aggregate associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, aggregates: None {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Refreshing trait associations for resource provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE {{(pid=75734) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:54:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:54:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:36 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:40 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:54:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:43 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:47 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:54:50 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:54:51 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:54:51 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:54:51 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:54:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:54:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:54:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:54:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:54:57 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:54:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 16:54:57 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] There are 0 instances to clean {{(pid=75734) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 16:55:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:55:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:55:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:55:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:55:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:55:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:55:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:55:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:55:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:55:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG nova.objects.instance [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'flavor' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:06 user nova-compute[75734]: INFO nova.compute.manager [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Attaching volume 19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 to /dev/vdb
Nov 22 16:55:06 user nova-compute[75734]: DEBUG os_brick.utils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b08525-0f8f-476f-8130-01f6fcd453a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:607b1ca86351\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d466a3-1260-4d0f-9dc8-afe90709b972]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f4299-f446-4d9c-b147-08573a88be7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea196da-7602-4284-b9e1-b271059fe248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Running cmd (subprocess): nvme version {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] 'nvme version' failed. Not Retrying. {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] nvme not present on system {{(pid=75734) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 16:55:06 user nova-compute[75734]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa815ee-6000-46c2-916c-3274f599c421]: (4, '') {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75734) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.lightos [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] LIGHTOS: no hostnqn found. {{(pid=75734) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG os_brick.utils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:607b1ca86351', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG nova.virt.block_device [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating existing volume attachment record: b6124ea3-1f4b-4d51-98ea-aed27215c3d1 {{(pid=75734) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 16:55:06 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:08 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75734) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 16:55:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Calling os-brick to attach iSCSI Volume {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToJFwWAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:55:12 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:55:12 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:55:12 user nova-compute[75734]: INFO os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b3a03-40d5-475c-a00f-3c24309350ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 16:55:12 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --interface default --op new {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a82d6b-3f4f-47fc-87fb-9d73a76a04d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93] added\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93] added
Nov 22 16:55:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b521d8-f598-4f72-99db-82dcbdce73c2]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[576d88d8-8267-4ee5-92b6-843f6902a5d5]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToJFwWAp {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToJFwWAp" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b38040-4471-4140-9b0c-f14c2c5e358c]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ToJFwWAp'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c293ecc-55ad-4e7a-9134-99771f04c526]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[940bfdb2-a0fd-40ec-af42-f16fe30e1de9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:55:12 user nova-compute[75734]:  {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 16:55:12 user nova-compute[75734]:  {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:55:12 user nova-compute[75734]: WARNING os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 16:55:12 user nova-compute[75734]: 
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --login {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a62cc3e-58c4-4bc2-8018-d7e3d09f3626]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260]
Nov 22 16:55:12 user nova-compute[75734]: Login to [iface: default, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260] successful.
Nov 22 16:55:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1bf578-09a8-4bd0-9f49-30bbb49d3735]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df7ac1-3b4b-476f-8322-44dab66f85ca]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 (non-flash)
Nov 22 16:55:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 (non-flash)
Nov 22 16:55:12 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Connected to 172.16.0.220:3260 {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75734) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75734) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2414e8-5798-480c-ba5f-0a81ae1a8c6b]: (4, ('- - 0', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75734) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 16:55:12 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToJFwWAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75734) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23962383764366131', 'path': '/dev/sdb'} {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962383764366131', 'path': '/dev/sdb'} {{(pid=75734) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG nova.objects.instance [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'flavor' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 16:55:13 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:55:13 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:55:13 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:55:13 user nova-compute[75734]:   <serial>19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93</serial>
Nov 22 16:55:13 user nova-compute[75734]: </disk>
Nov 22 16:55:13 user nova-compute[75734]:  {{(pid=75734) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75734) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] No VIF found with MAC fa:16:3e:21:00:72, not building metadata {{(pid=75734) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 16:55:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-32a43992-c804-425d-9059-0c09b90fc356 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.654s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG nova.compute.manager [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing instance network info cache due to event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated VIF entry in instance network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG nova.network.neutron [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-aecdba2e-4de8-4a16-9187-d36577ccfea9 req-2ce9d06c-daac-44f1-8e58-6bdbbbc3a40c service nova] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:55:17 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG nova.compute.manager [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing instance network info cache due to event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:19 user nova-compute[75734]: INFO nova.compute.manager [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Rebooting instance
Nov 22 16:55:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated VIF entry in instance network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG nova.network.neutron [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d4d6c50c-c53c-4986-a3a4-6a6e8c6f527e req-c5a82af2-8957-4d2f-8b93-97c129292a60 service nova] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:55:19 user nova-compute[75734]: DEBUG nova.network.neutron [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Building network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 16:55:20 user nova-compute[75734]: DEBUG nova.network.neutron [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:55:20 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:55:20 user nova-compute[75734]: DEBUG nova.compute.manager [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:55:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-b530f8f9-4c67-44c5-af06-3c3796974230 req-897be0ba-864d-451d-82ca-977bef1ef7cc service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-unplugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b530f8f9-4c67-44c5-af06-3c3796974230 req-897be0ba-864d-451d-82ca-977bef1ef7cc service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b530f8f9-4c67-44c5-af06-3c3796974230 req-897be0ba-864d-451d-82ca-977bef1ef7cc service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-b530f8f9-4c67-44c5-af06-3c3796974230 req-897be0ba-864d-451d-82ca-977bef1ef7cc service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:22 user nova-compute[75734]: DEBUG nova.compute.manager [req-b530f8f9-4c67-44c5-af06-3c3796974230 req-897be0ba-864d-451d-82ca-977bef1ef7cc service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-unplugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:55:22 user nova-compute[75734]: WARNING nova.compute.manager [req-b530f8f9-4c67-44c5-af06-3c3796974230 req-897be0ba-864d-451d-82ca-977bef1ef7cc service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received unexpected event network-vif-unplugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with vm_state active and task_state reboot_started.
Nov 22 16:55:23 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance shutdown successfully.
Nov 22 16:55:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-2653b547-2c5a-49e5-b1a5-7118d9db4d38 req-f4b9fd82-132c-4f1d-8c28-8776124561f9 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2653b547-2c5a-49e5-b1a5-7118d9db4d38 req-f4b9fd82-132c-4f1d-8c28-8776124561f9 service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2653b547-2c5a-49e5-b1a5-7118d9db4d38 req-f4b9fd82-132c-4f1d-8c28-8776124561f9 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-2653b547-2c5a-49e5-b1a5-7118d9db4d38 req-f4b9fd82-132c-4f1d-8c28-8776124561f9 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:24 user nova-compute[75734]: DEBUG nova.compute.manager [req-2653b547-2c5a-49e5-b1a5-7118d9db4d38 req-f4b9fd82-132c-4f1d-8c28-8776124561f9 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:55:24 user nova-compute[75734]: WARNING nova.compute.manager [req-2653b547-2c5a-49e5-b1a5-7118d9db4d38 req-f4b9fd82-132c-4f1d-8c28-8776124561f9 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received unexpected event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with vm_state active and task_state reboot_started.
Nov 22 16:55:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance running successfully.
Nov 22 16:55:26 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance soft rebooted successfully.
Nov 22 16:55:26 user nova-compute[75734]: DEBUG nova.compute.manager [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Checking state {{(pid=75734) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-57001503-0795-4342-82e8-f42d2f93837d tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.141s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:55:26 user nova-compute[75734]: WARNING nova.compute.manager [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received unexpected event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with vm_state active and task_state None.
Nov 22 16:55:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:26 user nova-compute[75734]: DEBUG nova.compute.manager [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:55:26 user nova-compute[75734]: WARNING nova.compute.manager [req-dd8acd86-2e73-431b-96d7-4289a66ec548 req-39d9f43e-b94c-4d79-9a72-d806b8817ca1 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received unexpected event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with vm_state active and task_state None.
Nov 22 16:55:27 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:32 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:55:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:55:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=24.845195770263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:55:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:55:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:55:42 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:55:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:47 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:49 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:55:52 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:55:53 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:55:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:55:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:55:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:55:57 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:56:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:56:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:56:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:56:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:56:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:56:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:56:35 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75734) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 16:56:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:56:36 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9064MB free_disk=24.84445571899414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:56:36 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:56:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:38 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:42 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:42 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:56:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:50 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:56:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:56:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:56:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:56:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:56:52 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:56:53 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:56:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:56:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:56:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:56:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:56:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:56:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:56:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:56:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:57:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:57:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:57:10 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG nova.compute.manager [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing instance network info cache due to event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG nova.network.neutron [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG nova.network.neutron [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated VIF entry in instance network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG nova.network.neutron [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:57:11 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-3bc2b585-efc2-4f38-ae0e-206efdfd6510 req-0ba08df3-7d01-46af-a77d-04642630fdab service nova] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:57:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:57:12 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:57:12 user nova-compute[75734]: INFO nova.compute.manager [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Detaching volume 19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93
Nov 22 16:57:12 user nova-compute[75734]: INFO nova.virt.block_device [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Attempting to driver detach volume 19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 from mountpoint /dev/vdb
Nov 22 16:57:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Attempting to detach device vdb from instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba from the persistent domain config. {{(pid=75734) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 16:57:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:57:12 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:57:12 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:57:12 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:57:12 user nova-compute[75734]:   <serial>19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93</serial>
Nov 22 16:57:12 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:57:12 user nova-compute[75734]: </disk>
Nov 22 16:57:12 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:57:12 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully detached device vdb from instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba from the persistent domain config.
Nov 22 16:57:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba from the live domain config. {{(pid=75734) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 16:57:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.guest [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 16:57:12 user nova-compute[75734]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 16:57:12 user nova-compute[75734]:   <source dev="/dev/sdb"/>
Nov 22 16:57:12 user nova-compute[75734]:   <target dev="vdb" bus="virtio"/>
Nov 22 16:57:12 user nova-compute[75734]:   <serial>19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93</serial>
Nov 22 16:57:12 user nova-compute[75734]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 16:57:12 user nova-compute[75734]: </disk>
Nov 22 16:57:12 user nova-compute[75734]:  {{(pid=75734) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 16:57:12 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:12 user nova-compute[75734]: DEBUG nova.virt.libvirt.driver [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG nova.compute.manager [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing instance network info cache due to event network-changed-0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Refreshing network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated VIF entry in instance network info cache for port 0ad71c1f-fa25-4b11-a994-9da8cd84249d. {{(pid=75734) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG nova.network.neutron [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:57:13 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-4fd6bb60-8f0a-4296-a124-9f625bd31bfc req-a23e3037-4ba2-47e8-9419-8e4a7af0f889 service nova] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:57:15 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:20 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:25 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:57:30 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:32 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba is timed out.
Nov 22 16:57:32 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully detached device vdb from instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba from the live domain config.
Nov 22 16:57:32 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] calling os-brick to detach iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4ecc464130>, {'target_iqn': 'iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToJFwWAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 16:57:32 user nova-compute[75734]: WARNING os_brick.initiator.connectors.base [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dfb446-75e3-44a5-9303-f20cf0cd9543]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 16:57:32 user nova-compute[75734]: No targets found.
Nov 22 16:57:32 user nova-compute[75734]: iSNS:
Nov 22 16:57:32 user nova-compute[75734]: No targets found.
Nov 22 16:57:32 user nova-compute[75734]: STATIC:
Nov 22 16:57:32 user nova-compute[75734]: Target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93
Nov 22 16:57:32 user nova-compute[75734]:         Portal: 172.16.0.220:3260,-1
Nov 22 16:57:32 user nova-compute[75734]:                 Iface Name: default
Nov 22 16:57:32 user nova-compute[75734]: FIRMWARE:
Nov 22 16:57:32 user nova-compute[75734]: No targets found.
Nov 22 16:57:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 16:57:32 user nova-compute[75734]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 16:57:32 user nova-compute[75734]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75734) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93', 0)] {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4abe3a-9c4c-496e-b537-cd9fcdc900dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ac1b56-f330-4f8a-ad89-ef9882b15657]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 (non-flash)\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 (non-flash)
Nov 22 16:57:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 (non-flash)
Nov 22 16:57:32 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4eac5e63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93'): ({'sdb'}, set())}) {{(pid=75734) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Removing single pathed devices sdb {{(pid=75734) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[07354132-9639-4ede-9768-e3bed42e281c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16f4a0d-b6e5-4b2a-b73e-f9f95128bfcb]: (4, ('ok\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Flushing IO for device /dev/sdb {{(pid=75734) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 16:57:32 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b26c24-45d2-425e-81ab-10050a889066]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75734) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472a5af-43c9-4dc5-8b97-3f47994ec5fa]: (4, ('1', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.linuxscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] SCSI volumes sdb have been removed. {{(pid=75734) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93')] {{(pid=75734) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde6cc81-ff31-4fb3-9163-156eea2d2c07]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --logout {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71f96f-73a5-491e-b4f7-9f1579bad6d4]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260]
Nov 22 16:57:33 user nova-compute[75734]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93, portal: 172.16.0.220,3260] successful.
Nov 22 16:57:33 user nova-compute[75734]:  stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op delete {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d627f5-ddd2-4e6a-b12f-2c4a30fd5e93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86452) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ff6878-bd50-4e3e-81fd-0867232f42f0]: (4, ('', '')) {{(pid=86452) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75734) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.base [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] <== disconnect_volume: return (283ms) None {{(pid=75734) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 16:57:33 user nova-compute[75734]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Disconnected iSCSI Volume {{(pid=75734) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 16:57:34 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'flavor' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:57:34 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0c01bd57-3c5e-4a4e-8e30-21f269325d25 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.055s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:57:35 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:37 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.processutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75734) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 16:57:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:57:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:57:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=24.843666076660156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75734) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:57:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:57:40 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:40 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:44 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:44 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:57:45 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:50 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:57:51 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:52 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:57:52 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:57:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 16:57:52 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquired lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 16:57:52 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Forcefully refreshing network info cache for instance {{(pid=75734) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 16:57:52 user nova-compute[75734]: DEBUG nova.objects.instance [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lazy-loading 'info_cache' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:57:53 user nova-compute[75734]: DEBUG nova.network.neutron [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [{"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:57:53 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Releasing lock "refresh_cache-15db7a53-0a04-485e-824c-bc6bd3d2d5ba" {{(pid=75734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 16:57:53 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updated the network info_cache for instance {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 16:57:55 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:57:55 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:00 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:05 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:58:08 user nova-compute[75734]: INFO nova.compute.manager [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Terminating instance
Nov 22 16:58:08 user nova-compute[75734]: DEBUG nova.compute.manager [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Start destroying the instance on the hypervisor. {{(pid=75734) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-d1222098-8e99-4a3e-8812-fbb80d28b4d1 req-abe37b24-a968-42a8-aca3-03ce752eb7d6 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-unplugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d1222098-8e99-4a3e-8812-fbb80d28b4d1 req-abe37b24-a968-42a8-aca3-03ce752eb7d6 service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d1222098-8e99-4a3e-8812-fbb80d28b4d1 req-abe37b24-a968-42a8-aca3-03ce752eb7d6 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-d1222098-8e99-4a3e-8812-fbb80d28b4d1 req-abe37b24-a968-42a8-aca3-03ce752eb7d6 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-d1222098-8e99-4a3e-8812-fbb80d28b4d1 req-abe37b24-a968-42a8-aca3-03ce752eb7d6 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-unplugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG nova.compute.manager [req-d1222098-8e99-4a3e-8812-fbb80d28b4d1 req-abe37b24-a968-42a8-aca3-03ce752eb7d6 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-unplugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with task_state deleting. {{(pid=75734) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:08 user nova-compute[75734]: INFO nova.virt.libvirt.driver [-] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Instance destroyed successfully.
Nov 22 16:58:08 user nova-compute[75734]: DEBUG nova.objects.instance [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lazy-loading 'resources' on Instance uuid 15db7a53-0a04-485e-824c-bc6bd3d2d5ba {{(pid=75734) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG nova.virt.libvirt.vif [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-14611227',display_name='tempest-TestMinimumBasicScenario-server-14611227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-14611227',id=52,image_ref='7bec2ab1-5967-4c09-b614-58a166860f90',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv8w6ruGJObwWc0q6dSYSsq11RgssbgIFm9K1lRc8nzW1XZzprANAmKCSERaM4pz9MGTTZssGdnPc7NtDGjI1HTknmqn5KemI/0QvlFMm1fjQATzum5kAPdC5I64wKbyQ==',key_name='tempest-TestMinimumBasicScenario-1206244178',keypairs=<?>,launch_index=0,launched_at=2023-11-22T16:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f475755bff84214abb76484eb3c2c1d',ramdisk_id='',reservation_id='r-u808znl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7bec2ab1-5967-4c09-b614-58a166860f90',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1450639333',owner_user_name='tempest-TestMinimumBasicScenario-1450639333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T16:55:27Z,user_data=None,user_id='6de85c2198a7410291259103e38c5202',uuid=15db7a53-0a04-485e-824c-bc6bd3d2d5ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 16:58:08 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converting VIF {"id": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "address": "fa:16:3e:21:00:72", "network": {"id": "528c37a5-e7a5-4326-b4f7-4142230d2686", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-513205609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f475755bff84214abb76484eb3c2c1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad71c1f-fa", "ovs_interfaceid": "0ad71c1f-fa25-4b11-a994-9da8cd84249d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG nova.network.os_vif_util [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:00:72,bridge_name='br-int',has_traffic_filtering=True,id=0ad71c1f-fa25-4b11-a994-9da8cd84249d,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad71c1f-fa') {{(pid=75734) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG os_vif [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:00:72,bridge_name='br-int',has_traffic_filtering=True,id=0ad71c1f-fa25-4b11-a994-9da8cd84249d,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad71c1f-fa') {{(pid=75734) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ad71c1f-fa, bridge=br-int, if_exists=True) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6e0a45f-0315-426a-847d-e33e57fd7408) {{(pid=75734) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:09 user nova-compute[75734]: INFO os_vif [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:00:72,bridge_name='br-int',has_traffic_filtering=True,id=0ad71c1f-fa25-4b11-a994-9da8cd84249d,network=Network(528c37a5-e7a5-4326-b4f7-4142230d2686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad71c1f-fa')
Nov 22 16:58:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Deleting instance files /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba_del
Nov 22 16:58:09 user nova-compute[75734]: INFO nova.virt.libvirt.driver [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Deletion of /opt/stack/data/nova/instances/15db7a53-0a04-485e-824c-bc6bd3d2d5ba_del complete
Nov 22 16:58:09 user nova-compute[75734]: INFO nova.compute.manager [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 16:58:09 user nova-compute[75734]: DEBUG oslo.service.loopingcall [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75734) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG nova.compute.manager [-] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Deallocating network for instance {{(pid=75734) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] deallocate_for_instance() {{(pid=75734) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG nova.network.neutron [-] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Updating instance_info_cache with network_info: [] {{(pid=75734) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 16:58:09 user nova-compute[75734]: INFO nova.compute.manager [-] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Took 0.55 seconds to deallocate network for instance.
Nov 22 16:58:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:58:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:58:09 user nova-compute[75734]: INFO nova.scheduler.client.report [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Deleted allocations for instance 15db7a53-0a04-485e-824c-bc6bd3d2d5ba
Nov 22 16:58:09 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-aacdd474-6bc8-47b4-a617-f1be93e63fc2 tempest-TestMinimumBasicScenario-1450639333 tempest-TestMinimumBasicScenario-1450639333-project-member] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.702s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:58:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-a3fec223-d061-4ab4-9f7c-98795607a040 req-b1642464-90f1-47a9-af60-9de498702392 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:58:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a3fec223-d061-4ab4-9f7c-98795607a040 req-b1642464-90f1-47a9-af60-9de498702392 service nova] Acquiring lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:58:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a3fec223-d061-4ab4-9f7c-98795607a040 req-b1642464-90f1-47a9-af60-9de498702392 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:58:10 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [req-a3fec223-d061-4ab4-9f7c-98795607a040 req-b1642464-90f1-47a9-af60-9de498702392 service nova] Lock "15db7a53-0a04-485e-824c-bc6bd3d2d5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:58:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-a3fec223-d061-4ab4-9f7c-98795607a040 req-b1642464-90f1-47a9-af60-9de498702392 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] No waiting events found dispatching network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 16:58:10 user nova-compute[75734]: WARNING nova.compute.manager [req-a3fec223-d061-4ab4-9f7c-98795607a040 req-b1642464-90f1-47a9-af60-9de498702392 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received unexpected event network-vif-plugged-0ad71c1f-fa25-4b11-a994-9da8cd84249d for instance with vm_state deleted and task_state None.
Nov 22 16:58:10 user nova-compute[75734]: DEBUG nova.compute.manager [req-a3fec223-d061-4ab4-9f7c-98795607a040 req-b1642464-90f1-47a9-af60-9de498702392 service nova] [instance: 15db7a53-0a04-485e-824c-bc6bd3d2d5ba] Received event network-vif-deleted-0ad71c1f-fa25-4b11-a994-9da8cd84249d {{(pid=75734) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 16:58:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75734) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 16:58:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:58:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75734) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 16:58:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:29 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:34 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:37 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:58:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:58:37 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:58:37 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Auditing locally available compute resources for user (node: user) {{(pid=75734) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 16:58:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:58:38 user nova-compute[75734]: WARNING nova.virt.libvirt.driver [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 16:58:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Hypervisor/Node resource view: name=user free_ram=9197MB free_disk=24.87100601196289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75734) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75734) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG nova.compute.provider_tree [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed in ProviderTree for provider: 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 {{(pid=75734) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG nova.scheduler.client.report [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Inventory has not changed for provider 37d0620c-15f4-4d5b-869d-cafca8d2e0e2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75734) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG nova.compute.resource_tracker [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Compute_service record updated for user:user {{(pid=75734) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 16:58:38 user nova-compute[75734]: DEBUG oslo_concurrency.lockutils [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75734) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 16:58:39 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 16:58:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:41 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:44 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:45 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:45 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75734) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 16:58:46 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:48 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:49 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:53 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:54 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:58:54 user nova-compute[75734]: DEBUG oslo_service.periodic_task [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75734) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 16:58:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Starting heal instance info cache {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 16:58:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Rebuilding the list of instances to heal {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 16:58:54 user nova-compute[75734]: DEBUG nova.compute.manager [None req-0badb003-a1ff-4bcc-87b6-048c85ec4b33 None None] Didn't find any instances for network info cache update. {{(pid=75734) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 16:58:59 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:01 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:04 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:09 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:14 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:19 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 16:59:24 user nova-compute[75734]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75734) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}